Nov 16 05:24:49 user nova-compute[80928]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=80928) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 05:24:49 user nova-compute[80928]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=80928) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 05:24:49 user nova-compute[80928]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=80928) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 05:24:49 user nova-compute[80928]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 16 05:24:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:24:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:24:49 user nova-compute[80928]: INFO nova.virt.driver [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 16 05:24:50 user nova-compute[80928]: INFO nova.compute.provider_config [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] Acquiring lock "singleton_lock" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] Acquired lock "singleton_lock" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] Releasing lock "singleton_lock" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] Full set of CONF: {{(pid=80928) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ******************************************************************************** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] Configuration options gathered from: {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ================================================================================ {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] allow_resize_to_same_host      = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] arq_binding_timeout            = 300 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] backdoor_port                  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] backdoor_socket                = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] block_device_allocate_retries  = 300 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] block_device_allocate_retries_interval = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cert                           = self.pem {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute_monitors               = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] config_dir                     = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] config_drive_format            = iso9660 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] config_source                  = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] console_host                   = user {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] control_exchange               = nova {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cpu_allocation_ratio           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] daemon                         = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] debug                          = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] default_access_ip_network_name = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] default_availability_zone      = nova {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] default_ephemeral_format       = ext4 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] default_green_pool_size        = 1000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] default_schedule_zone          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] disk_allocation_ratio          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] enable_new_services            = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] enabled_apis                   = ['osapi_compute'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] enabled_ssl_apis               = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] flat_injected                  = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] force_config_drive             = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] force_raw_images               = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] graceful_shutdown_timeout      = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] heal_instance_info_cache_interval = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] host                           = user {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] instance_build_timeout         = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] instance_delete_interval       = 300 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] instance_format                = [instance: %(uuid)s]  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] instance_name_template         = instance-%08x {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] instance_usage_audit           = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] instance_usage_audit_period    = month {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] internal_service_availability_zone = internal {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] key                            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] live_migration_retry_count     = 30 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] log_config_append              = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] log_dir                        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] log_file                       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] log_options                    = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] log_rotate_interval            = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] log_rotate_interval_type       = days {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] log_rotation_type              = none {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] long_rpc_timeout               = 1800 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] max_concurrent_builds          = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] max_concurrent_live_migrations = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] max_concurrent_snapshots       = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] max_local_block_devices        = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] max_logfile_count              = 30 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] max_logfile_size_mb            = 200 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] maximum_instance_delete_attempts = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] metadata_listen                = 0.0.0.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] metadata_listen_port           = 8775 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] metadata_workers               = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] migrate_max_retries            = -1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] mkisofs_cmd                    = genisoimage {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] my_ip                          = 10.0.0.210 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] network_allocate_retries       = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] osapi_compute_listen_port      = 8774 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] osapi_compute_unique_server_name_scope =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] osapi_compute_workers          = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] password_length                = 12 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] periodic_enable                = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] periodic_fuzzy_delay           = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] pointer_model                  = ps2mouse {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] preallocate_images             = none {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] publish_errors                 = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] pybasedir                      = /opt/stack/nova {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ram_allocation_ratio           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] rate_limit_burst               = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] rate_limit_except_level        = CRITICAL {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] rate_limit_interval            = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] reboot_timeout                 = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] reclaim_instance_interval      = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] record                         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] reimage_timeout_per_gb         = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] report_interval                = 120 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] rescue_timeout                 = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] reserved_host_cpus             = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] reserved_host_disk_mb          = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] reserved_host_memory_mb        = 512 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] reserved_huge_pages            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] resize_confirm_window          = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] resize_fs_using_block_device   = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] resume_guests_state_on_host_boot = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] rpc_response_timeout           = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] run_external_periodic_tasks    = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] running_deleted_instance_action = reap {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] running_deleted_instance_poll_interval = 1800 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] running_deleted_instance_timeout = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] scheduler_instance_sync_interval = 120 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] service_down_time              = 720 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] servicegroup_driver            = db {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] shelved_offload_time           = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] shelved_poll_interval          = 3600 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] shutdown_timeout               = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] source_is_ipv6                 = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ssl_only                       = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] state_path                     = /opt/stack/data/nova {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] sync_power_state_interval      = 600 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] sync_power_state_pool_size     = 1000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] syslog_log_facility            = LOG_USER {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] tempdir                        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] timeout_nbd                    = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] transport_url                  = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] update_resources_interval      = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] use_cow_images                 = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] use_eventlog                   = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] use_journal                    = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] use_json                       = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] use_rootwrap_daemon            = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] use_stderr                     = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] use_syslog                     = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vcpu_pin_set                   = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plugging_is_fatal          = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plugging_timeout           = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] virt_mkfs                      = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] volume_usage_poll_interval     = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] watch_log_file                 = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] web                            = /usr/share/spice-html5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_concurrency.disable_process_locking = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.auth_strategy              = keystone {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.compute_link_prefix        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.dhcp_domain                = novalocal {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.enable_instance_password   = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.glance_link_prefix         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.instance_list_per_project_cells = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.list_records_by_skipping_down_cells = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.local_metadata_per_cell    = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.max_limit                  = 1000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.metadata_cache_expiration  = 15 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.neutron_default_tenant_id  = default {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.use_forwarded_for          = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.use_neutron_default_nets   = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.vendordata_dynamic_targets = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.vendordata_jsonfile_path   = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.backend                  = dogpile.cache.memcached {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.backend_argument         = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.config_prefix            = cache.oslo {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.dead_timeout             = 60.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.debug_cache_backend      = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.enable_retry_client      = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.enable_socket_keepalive  = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.enabled                  = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.expiration_time          = 600 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.hashclient_retry_attempts = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.memcache_dead_retry      = 300 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.memcache_password        =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.memcache_pool_maxsize    = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.memcache_sasl_enabled    = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.memcache_username        =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.proxies                  = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.retry_attempts           = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.retry_delay              = 0.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.socket_keepalive_count   = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.socket_keepalive_idle    = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.socket_keepalive_interval = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.tls_allowed_ciphers      = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.tls_cafile               = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.tls_certfile             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.tls_enabled              = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cache.tls_keyfile              = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.auth_section            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.auth_type               = password {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.cafile                  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.certfile                = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.collect_timing          = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.cross_az_attach         = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.debug                   = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.endpoint_template       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.http_retries            = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.insecure                = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.keyfile                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.os_region_name          = RegionOne {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.split_loggers           = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cinder.timeout                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute.cpu_dedicated_set      = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute.cpu_shared_set         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute.image_type_exclude_list = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute.max_concurrent_disk_ops = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute.max_disk_devices_to_attach = -1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute.resource_provider_association_refresh = 300 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute.shutdown_retry_interval = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] conductor.workers              = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] console.allowed_origins        = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] console.ssl_ciphers            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] console.ssl_minimum_version    = default {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] consoleauth.token_ttl          = 600 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.cafile                  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.certfile                = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.collect_timing          = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.connect_retries         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.connect_retry_delay     = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.endpoint_override       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.insecure                = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.keyfile                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.max_version             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.min_version             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.region_name             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.service_name            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.service_type            = accelerator {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.split_loggers           = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.status_code_retries     = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.status_code_retry_delay = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.timeout                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] cyborg.version                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.backend               = sqlalchemy {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.connection            = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.connection_debug      = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.connection_parameters =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.connection_recycle_time = 3600 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.connection_trace      = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.db_inc_retry_interval = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.db_max_retries        = 20 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.db_max_retry_interval = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.db_retry_interval     = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.max_overflow          = 50 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.max_pool_size         = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.max_retries           = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.mysql_wsrep_sync_wait = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.pool_timeout          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.retry_interval        = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.slave_connection      = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] database.sqlite_synchronous    = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.backend           = sqlalchemy {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.connection        = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.connection_debug  = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.connection_parameters =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.connection_recycle_time = 3600 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.connection_trace  = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.db_inc_retry_interval = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.db_max_retries    = 20 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.db_max_retry_interval = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.db_retry_interval = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.max_overflow      = 50 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.max_pool_size     = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.max_retries       = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.pool_timeout      = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.retry_interval    = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.slave_connection  = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] api_database.sqlite_synchronous = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] devices.enabled_mdev_types     = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ephemeral_storage_encryption.enabled = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.api_servers             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.cafile                  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.certfile                = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.collect_timing          = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.connect_retries         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.connect_retry_delay     = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.debug                   = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.default_trusted_certificate_ids = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.enable_certificate_validation = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.enable_rbd_download     = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.endpoint_override       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.insecure                = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.keyfile                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.max_version             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.min_version             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.num_retries             = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.rbd_ceph_conf           =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.rbd_connect_timeout     = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.rbd_pool                =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.rbd_user                =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.region_name             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.service_name            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.service_type            = image {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.split_loggers           = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.status_code_retries     = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.status_code_retry_delay = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.timeout                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.verify_glance_signatures = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] glance.version                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] guestfs.debug                  = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.config_drive_cdrom      = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.config_drive_inject_password = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.enable_instance_metrics_collection = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.enable_remotefx         = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.instances_path_share    =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.iscsi_initiator_list    = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.limit_cpu_features      = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.power_state_check_timeframe = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.use_multipath_io        = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.volume_attach_retry_count = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.vswitch_name            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] mks.enabled                    = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] image_cache.manager_interval   = 2400 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] image_cache.precache_concurrency = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] image_cache.remove_unused_base_images = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] image_cache.subdirectory_name  = _base {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.api_max_retries         = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.api_retry_interval      = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.auth_section            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.auth_type               = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.cafile                  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.certfile                = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.collect_timing          = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.conductor_group         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.connect_retries         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.connect_retry_delay     = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.endpoint_override       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.insecure                = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.keyfile                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.max_version             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.min_version             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.peer_list               = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.region_name             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.serial_console_state_timeout = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.service_name            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.service_type            = baremetal {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.split_loggers           = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.status_code_retries     = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.status_code_retry_delay = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.timeout                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ironic.version                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] key_manager.fixed_key          = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.barbican_api_version  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.barbican_endpoint     = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.barbican_endpoint_type = public {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.barbican_region_name  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.cafile                = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.certfile              = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.collect_timing        = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.insecure              = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.keyfile               = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.number_of_retries     = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.retry_delay           = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.send_service_user_token = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.split_loggers         = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.timeout               = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.verify_ssl            = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican.verify_ssl_path       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican_service_user.auth_section = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican_service_user.auth_type = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican_service_user.cafile   = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican_service_user.certfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican_service_user.collect_timing = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican_service_user.insecure = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican_service_user.keyfile  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican_service_user.split_loggers = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] barbican_service_user.timeout  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.approle_role_id          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.approle_secret_id        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.cafile                   = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.certfile                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.collect_timing           = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.insecure                 = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.keyfile                  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.kv_mountpoint            = secret {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.kv_path                  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.kv_version               = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.namespace                = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.root_token_id            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.split_loggers            = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.ssl_ca_crt_file          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.timeout                  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.use_ssl                  = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.auth_section          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.auth_type             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.cafile                = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.certfile              = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.collect_timing        = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.connect_retries       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.connect_retry_delay   = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.endpoint_override     = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.insecure              = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.keyfile               = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.max_version           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.min_version           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.region_name           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.service_name          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.service_type          = identity {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.split_loggers         = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.status_code_retries   = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.status_code_retry_delay = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.timeout               = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] keystone.version               = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.connection_uri         =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.cpu_mode               = custom {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: WARNING oslo_config.cfg [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.cpu_power_governor_high = performance {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.cpu_power_governor_low = powersave {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.cpu_power_management   = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.device_detach_attempts = 8 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.device_detach_timeout  = 20 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.disk_cachemodes        = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.disk_prefix            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.enabled_perf_events    = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.file_backed_memory     = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.gid_maps               = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.hw_disk_discard        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.hw_machine_type        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.images_rbd_glance_store_name =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.images_rbd_pool        = rbd {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.images_type            = default {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.images_volume_group    = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.inject_key             = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.inject_partition       = -2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.inject_password        = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.iscsi_iface            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.iser_use_multipath     = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_bandwidth = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_downtime = 500 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_inbound_addr = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_permit_post_copy = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_scheme  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_timeout_action = abort {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_tunnelled = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: WARNING oslo_config.cfg [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 16 05:24:50 user nova-compute[80928]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 16 05:24:50 user nova-compute[80928]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 16 05:24:50 user nova-compute[80928]: and ``live_migration_inbound_addr`` respectively.
Nov 16 05:24:50 user nova-compute[80928]: ).  Its value may be silently ignored in the future.
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.live_migration_with_native_tls = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.max_queues             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.nfs_mount_options      = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.num_memory_encrypted_guests = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.num_pcie_ports         = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.pmem_namespaces        = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.quobyte_client_cfg     = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.rbd_secret_uuid        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.rbd_user               = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.remote_filesystem_transport = ssh {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.rescue_image_id        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.rescue_kernel_id       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.rescue_ramdisk_id      = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.rx_queue_size          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.smbfs_mount_options    =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.snapshot_compression   = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.snapshot_image_format  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.sparse_logical_volumes = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.swtpm_enabled          = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.swtpm_group            = tss {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.swtpm_user             = tss {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.sysinfo_serial         = unique {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.tb_cache_size          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.tx_queue_size          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.uid_maps               = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.use_virtio_for_bridges = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.virt_type              = kvm {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.volume_clear           = zero {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.volume_clear_size      = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.volume_use_multipath   = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.vzstorage_cache_path   = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.vzstorage_mount_user   = stack {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.auth_section           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.auth_type              = password {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.cafile                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.certfile               = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.collect_timing         = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.connect_retries        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.connect_retry_delay    = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.default_floating_pool  = public {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.endpoint_override      = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.extension_sync_interval = 600 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.http_retries           = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.insecure               = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.keyfile                = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.max_version            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.min_version            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.ovs_bridge             = br-int {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.physnets               = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.region_name            = RegionOne {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.service_metadata_proxy = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.service_name           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.service_type           = network {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.split_loggers          = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.status_code_retries    = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.status_code_retry_delay = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.timeout                = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] neutron.version                = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] notifications.bdms_in_notifications = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] notifications.default_level    = INFO {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] notifications.notification_format = unversioned {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] notifications.notify_on_state_change = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] pci.alias                      = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] pci.device_spec                = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] pci.report_in_placement        = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.auth_section         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.auth_type            = password {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.cafile               = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.certfile             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.collect_timing       = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.connect_retries      = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.connect_retry_delay  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.default_domain_id    = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.default_domain_name  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.domain_id            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.domain_name          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.endpoint_override    = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.insecure             = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.keyfile              = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.max_version          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.min_version          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.password             = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.project_domain_id    = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.project_domain_name  = Default {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.project_id           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.project_name         = service {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.region_name          = RegionOne {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.service_name         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.service_type         = placement {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.split_loggers        = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.status_code_retries  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.status_code_retry_delay = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.system_scope         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.timeout              = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.trust_id             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.user_domain_id       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.user_domain_name     = Default {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.user_id              = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.username             = placement {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] placement.version              = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.cores                    = 20 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.count_usage_from_placement = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.injected_file_content_bytes = 10240 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.injected_file_path_length = 255 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.injected_files           = 5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.instances                = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.key_pairs                = 100 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.metadata_items           = 128 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.ram                      = 51200 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.recheck_quota            = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.server_group_members     = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] quota.server_groups            = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] rdp.enabled                    = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] scheduler.image_metadata_prefilter = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] scheduler.max_attempts         = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] scheduler.max_placement_results = 1000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] scheduler.query_placement_for_image_type_support = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] scheduler.workers              = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.host_subset_size = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.isolated_hosts = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.isolated_images = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.pci_in_placement = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.track_instance_changes = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] metrics.required               = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] metrics.weight_multiplier      = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] metrics.weight_setting         = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] serial_console.enabled         = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] serial_console.port_range      = 10000:20000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] serial_console.serialproxy_port = 6083 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] service_user.auth_section      = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] service_user.auth_type         = password {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] service_user.cafile            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] service_user.certfile          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] service_user.collect_timing    = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] service_user.insecure          = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] service_user.keyfile           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] service_user.send_service_user_token = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] service_user.split_loggers     = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] service_user.timeout           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] spice.agent_enabled            = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] spice.enabled                  = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] spice.html5proxy_port          = 6082 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] spice.image_compression        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] spice.jpeg_compression         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] spice.playback_compression     = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] spice.server_listen            = 127.0.0.1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] spice.streaming_mode           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] spice.zlib_compression         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] upgrade_levels.baseapi         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] upgrade_levels.cert            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] upgrade_levels.compute         = auto {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] upgrade_levels.conductor       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] upgrade_levels.scheduler       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vendordata_dynamic_auth.auth_section = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vendordata_dynamic_auth.auth_type = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vendordata_dynamic_auth.cafile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vendordata_dynamic_auth.certfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vendordata_dynamic_auth.insecure = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vendordata_dynamic_auth.keyfile = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vendordata_dynamic_auth.timeout = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.api_retry_count         = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.ca_file                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.cache_prefix            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.cluster_name            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.connection_pool_size    = 10 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.console_delay_seconds   = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.datastore_regex         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.host_ip                 = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.host_password           = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.host_port               = 443 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.host_username           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.insecure                = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.integration_bridge      = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.maximum_objects         = 100 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.pbm_default_policy      = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.pbm_enabled             = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.pbm_wsdl_location       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.serial_port_proxy_uri   = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.serial_port_service_uri = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.task_poll_interval      = 0.5 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.use_linked_clone        = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.vnc_keymap              = en-us {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.vnc_port                = 5900 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vmware.vnc_port_total          = 10000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vnc.auth_schemes               = ['none'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vnc.enabled                    = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vnc.novncproxy_port            = 6080 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vnc.server_listen              = 0.0.0.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vnc.vencrypt_ca_certs          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vnc.vencrypt_client_cert       = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vnc.vencrypt_client_key        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.disable_rootwrap   = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.enable_numa_live_migration = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.libvirt_disable_apic = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] wsgi.client_socket_timeout     = 900 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] wsgi.default_pool_size         = 1000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] wsgi.keep_alive                = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] wsgi.max_header_line           = 16384 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] wsgi.ssl_ca_file               = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] wsgi.ssl_cert_file             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] wsgi.ssl_key_file              = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] wsgi.tcp_keepidle              = 600 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] zvm.ca_file                    = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] zvm.cloud_connector_url        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] zvm.reachable_timeout          = 300 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_policy.enforce_new_defaults = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_policy.enforce_scope      = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_policy.policy_default_rule = default {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_policy.policy_file        = policy.yaml {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler.connection_string     = messaging:// {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler.enabled               = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler.es_doc_type           = notification {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler.es_scroll_size        = 10000 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler.es_scroll_time        = 2m {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler.filter_error_trace    = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler.hmac_keys             = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler.sentinel_service_name = mymaster {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler.socket_timeout        = 0.1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler.trace_requests        = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler.trace_sqlalchemy      = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler_jaeger.process_tags   = {} {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler_jaeger.service_name_prefix = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] profiler_otlp.service_name_prefix = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] remote_debug.host              = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] remote_debug.port              = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.ssl      = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_notifications.retry = -1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_messaging_notifications.transport_url = **** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.auth_section        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.auth_type           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.cafile              = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.certfile            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.collect_timing      = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.connect_retries     = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.connect_retry_delay = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.endpoint_id         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.endpoint_override   = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.insecure            = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.keyfile             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.max_version         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.min_version         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.region_name         = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.service_name        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.service_type        = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.split_loggers       = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.status_code_retries = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.status_code_retry_delay = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.timeout             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.valid_interfaces    = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_limit.version             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_reports.file_event_handler = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] oslo_reports.log_dir           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plug_ovs_privileged.group  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] vif_plug_ovs_privileged.user   = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_linux_bridge.flat_interface = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_ovs.isolate_vif         = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_vif_ovs.per_port_bridge     = False {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] os_brick.lock_path             = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] privsep_osbrick.capabilities   = [21] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] privsep_osbrick.group          = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] privsep_osbrick.helper_command = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] privsep_osbrick.user           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] nova_sys_admin.group           = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] nova_sys_admin.helper_command  = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] nova_sys_admin.user            = None {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG oslo_service.service [None req-61571e37-1074-4236-aed8-fcdce7b2b379 None None] ******************************************************************************** {{(pid=80928) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 16 05:24:50 user nova-compute[80928]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 16 05:24:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Connecting to libvirt: qemu:///system {{(pid=80928) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f8689b16410> {{(pid=80928) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 16 05:24:50 user nova-compute[80928]: libvirt:  error : internal error: could not initialize domain event timer
Nov 16 05:24:50 user nova-compute[80928]: WARNING nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 16 05:24:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f8689b16410> {{(pid=80928) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Starting native event thread {{(pid=80928) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Starting green dispatch thread {{(pid=80928) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 16 05:24:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Starting connection event dispatch thread {{(pid=80928) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 16 05:24:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Connection event '1' reason 'None'
Nov 16 05:24:50 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 05:24:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.mount [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Initialising _HostMountState generation 0 {{(pid=80928) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 16 05:24:57 user nova-compute[80928]: INFO nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Libvirt host capabilities <capabilities>
Nov 16 05:24:57 user nova-compute[80928]:   <host>
Nov 16 05:24:57 user nova-compute[80928]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 16 05:24:57 user nova-compute[80928]:     <cpu>
Nov 16 05:24:57 user nova-compute[80928]:       <arch>x86_64</arch>
Nov 16 05:24:57 user nova-compute[80928]:       <model>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <vendor>Intel</vendor>
Nov 16 05:24:57 user nova-compute[80928]:       <microcode version='1070'/>
Nov 16 05:24:57 user nova-compute[80928]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 16 05:24:57 user nova-compute[80928]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='ss'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='vmx'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='pcid'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='osxsave'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='hypervisor'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='arat'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='tsc_adjust'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='md-clear'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='arch-capabilities'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='invtsc'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='rsba'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature name='skip-l1dfl-vmentry'/>
Nov 16 05:24:57 user nova-compute[80928]:       <pages unit='KiB' size='4'/>
Nov 16 05:24:57 user nova-compute[80928]:       <pages unit='KiB' size='2048'/>
Nov 16 05:24:57 user nova-compute[80928]:     </cpu>
Nov 16 05:24:57 user nova-compute[80928]:     <power_management>
Nov 16 05:24:57 user nova-compute[80928]:       <suspend_mem/>
Nov 16 05:24:57 user nova-compute[80928]:       <suspend_disk/>
Nov 16 05:24:57 user nova-compute[80928]:       <suspend_hybrid/>
Nov 16 05:24:57 user nova-compute[80928]:     </power_management>
Nov 16 05:24:57 user nova-compute[80928]:     <iommu support='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     <migration_features>
Nov 16 05:24:57 user nova-compute[80928]:       <live/>
Nov 16 05:24:57 user nova-compute[80928]:       <uri_transports>
Nov 16 05:24:57 user nova-compute[80928]:         <uri_transport>tcp</uri_transport>
Nov 16 05:24:57 user nova-compute[80928]:         <uri_transport>rdma</uri_transport>
Nov 16 05:24:57 user nova-compute[80928]:       </uri_transports>
Nov 16 05:24:57 user nova-compute[80928]:     </migration_features>
Nov 16 05:24:57 user nova-compute[80928]:     <topology>
Nov 16 05:24:57 user nova-compute[80928]:       <cells num='2'>
Nov 16 05:24:57 user nova-compute[80928]:         <cell id='0'>
Nov 16 05:24:57 user nova-compute[80928]:           <memory unit='KiB'>8140616</memory>
Nov 16 05:24:57 user nova-compute[80928]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 16 05:24:57 user nova-compute[80928]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 05:24:57 user nova-compute[80928]:           <distances>
Nov 16 05:24:57 user nova-compute[80928]:             <sibling id='0' value='10'/>
Nov 16 05:24:57 user nova-compute[80928]:             <sibling id='1' value='20'/>
Nov 16 05:24:57 user nova-compute[80928]:           </distances>
Nov 16 05:24:57 user nova-compute[80928]:           <cpus num='6'>
Nov 16 05:24:57 user nova-compute[80928]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 16 05:24:57 user nova-compute[80928]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 16 05:24:57 user nova-compute[80928]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 16 05:24:57 user nova-compute[80928]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 16 05:24:57 user nova-compute[80928]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 16 05:24:57 user nova-compute[80928]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 16 05:24:57 user nova-compute[80928]:           </cpus>
Nov 16 05:24:57 user nova-compute[80928]:         </cell>
Nov 16 05:24:57 user nova-compute[80928]:         <cell id='1'>
Nov 16 05:24:57 user nova-compute[80928]:           <memory unit='KiB'>8255100</memory>
Nov 16 05:24:57 user nova-compute[80928]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 16 05:24:57 user nova-compute[80928]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 05:24:57 user nova-compute[80928]:           <distances>
Nov 16 05:24:57 user nova-compute[80928]:             <sibling id='0' value='20'/>
Nov 16 05:24:57 user nova-compute[80928]:             <sibling id='1' value='10'/>
Nov 16 05:24:57 user nova-compute[80928]:           </distances>
Nov 16 05:24:57 user nova-compute[80928]:           <cpus num='6'>
Nov 16 05:24:57 user nova-compute[80928]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 16 05:24:57 user nova-compute[80928]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 16 05:24:57 user nova-compute[80928]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 16 05:24:57 user nova-compute[80928]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 16 05:24:57 user nova-compute[80928]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 16 05:24:57 user nova-compute[80928]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 16 05:24:57 user nova-compute[80928]:           </cpus>
Nov 16 05:24:57 user nova-compute[80928]:         </cell>
Nov 16 05:24:57 user nova-compute[80928]:       </cells>
Nov 16 05:24:57 user nova-compute[80928]:     </topology>
Nov 16 05:24:57 user nova-compute[80928]:     <cache>
Nov 16 05:24:57 user nova-compute[80928]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 16 05:24:57 user nova-compute[80928]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 16 05:24:57 user nova-compute[80928]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 16 05:24:57 user nova-compute[80928]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 16 05:24:57 user nova-compute[80928]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 16 05:24:57 user nova-compute[80928]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 16 05:24:57 user nova-compute[80928]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 16 05:24:57 user nova-compute[80928]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 16 05:24:57 user nova-compute[80928]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 16 05:24:57 user nova-compute[80928]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 16 05:24:57 user nova-compute[80928]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 16 05:24:57 user nova-compute[80928]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 16 05:24:57 user nova-compute[80928]:     </cache>
Nov 16 05:24:57 user nova-compute[80928]:     <secmodel>
Nov 16 05:24:57 user nova-compute[80928]:       <model>apparmor</model>
Nov 16 05:24:57 user nova-compute[80928]:       <doi>0</doi>
Nov 16 05:24:57 user nova-compute[80928]:     </secmodel>
Nov 16 05:24:57 user nova-compute[80928]:     <secmodel>
Nov 16 05:24:57 user nova-compute[80928]:       <model>dac</model>
Nov 16 05:24:57 user nova-compute[80928]:       <doi>0</doi>
Nov 16 05:24:57 user nova-compute[80928]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 16 05:24:57 user nova-compute[80928]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 16 05:24:57 user nova-compute[80928]:     </secmodel>
Nov 16 05:24:57 user nova-compute[80928]:   </host>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='alpha'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>64</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>clipper</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='armv6l'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>spitz</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>nuri</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>kzm</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sx1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>z2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>tosa</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>n810</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>n800</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>terrier</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>midway</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>microbit</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>verdex</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>highbank</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>akita</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>connex</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>collie</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='armv7l'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>spitz</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>nuri</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>kzm</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sx1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>z2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>tosa</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>n810</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>n800</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>terrier</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>midway</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>microbit</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>verdex</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>highbank</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>akita</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>connex</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>collie</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='aarch64'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>64</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>spitz</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>nuri</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>kzm</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sx1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>z2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>tosa</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>n810</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>n800</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>terrier</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>midway</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>microbit</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>verdex</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>raspi3b</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>highbank</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>akita</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>connex</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>collie</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <acpi default='on' toggle='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='cris'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='i686'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>isapc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>microvm</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='kvm'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <pae/>
Nov 16 05:24:57 user nova-compute[80928]:       <nonpae/>
Nov 16 05:24:57 user nova-compute[80928]:       <acpi default='on' toggle='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:       <apic default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='m68k'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>an5206</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>q800</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>next-cube</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='microblaze'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='microblazeel'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='mips'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='16'>malta</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='mipsel'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='16'>malta</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='mips64'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>64</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='16'>malta</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>pica61</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>magnum</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='mips64el'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>64</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='16'>malta</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>pica61</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>magnum</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='16'>boston</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='ppc'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mac99</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>40p</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>taihu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='ppc64'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>64</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>taihu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>40p</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mac99</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='ppc64le'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>64</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>taihu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>40p</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>mac99</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='riscv32'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='8'>spike</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>opentitan</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='8'>virt</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='riscv64'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>64</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='8'>spike</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>shakti_c</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='8'>virt</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='s390x'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>64</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='sh4'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>shix</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>r2d</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='sh4eb'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>64</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>shix</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>r2d</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='sparc'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>SS-5</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>SS-20</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>LX</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>SS-4</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>SS-10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>Voyager</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='sparc64'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>64</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sun4u</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>niagara</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>sun4v</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='x86_64'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>64</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='1'>isapc</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>microvm</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='kvm'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <acpi default='on' toggle='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:       <apic default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='xtensa'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>sim</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>kc705</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>ml605</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>virt</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>lx200</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>lx60</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]:   <guest>
Nov 16 05:24:57 user nova-compute[80928]:     <os_type>hvm</os_type>
Nov 16 05:24:57 user nova-compute[80928]:     <arch name='xtensaeb'>
Nov 16 05:24:57 user nova-compute[80928]:       <wordsize>32</wordsize>
Nov 16 05:24:57 user nova-compute[80928]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='4'>sim</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>kc705</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>ml605</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>virt</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>lx200</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>lx60</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 05:24:57 user nova-compute[80928]:       <domain type='qemu'/>
Nov 16 05:24:57 user nova-compute[80928]:     </arch>
Nov 16 05:24:57 user nova-compute[80928]:     <features>
Nov 16 05:24:57 user nova-compute[80928]:       <cpuselection/>
Nov 16 05:24:57 user nova-compute[80928]:       <deviceboot/>
Nov 16 05:24:57 user nova-compute[80928]:       <disksnapshot default='on' toggle='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     </features>
Nov 16 05:24:57 user nova-compute[80928]:   </guest>
Nov 16 05:24:57 user nova-compute[80928]: </capabilities>
Nov 16 05:24:57 user nova-compute[80928]: 
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 16 05:24:57 user nova-compute[80928]: <domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 05:24:57 user nova-compute[80928]:   <domain>kvm</domain>
Nov 16 05:24:57 user nova-compute[80928]:   <machine>pc-i440fx-jammy</machine>
Nov 16 05:24:57 user nova-compute[80928]:   <arch>i686</arch>
Nov 16 05:24:57 user nova-compute[80928]:   <vcpu max='255'/>
Nov 16 05:24:57 user nova-compute[80928]:   <iothreads supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:   <os supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='firmware'/>
Nov 16 05:24:57 user nova-compute[80928]:     <loader supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>rom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pflash</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='readonly'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>yes</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='secure'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </loader>
Nov 16 05:24:57 user nova-compute[80928]:   </os>
Nov 16 05:24:57 user nova-compute[80928]:   <cpu>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-passthrough' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='hostPassthroughMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='maximum' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='maximumMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>on</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-model' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <vendor>Intel</vendor>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ss'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='vmx'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='pcid'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='hypervisor'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arat'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='umip'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='md-clear'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibpb'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibrs'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='erms'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='lm'/>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='custom' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>qemu64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>qemu32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>phenom</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>n270</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>kvm64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>kvm32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>coreduo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>core2duo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>athlon</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Westmere</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Snowridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Penryn</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G5</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G4</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G1</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Nehalem</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Rome</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Milan</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Dhyana</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cooperlake</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Conroe</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>486</model>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:   </cpu>
Nov 16 05:24:57 user nova-compute[80928]:   <memoryBacking supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='sourceType'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>file</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>anonymous</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>memfd</value>
Nov 16 05:24:57 user nova-compute[80928]:     </enum>
Nov 16 05:24:57 user nova-compute[80928]:   </memoryBacking>
Nov 16 05:24:57 user nova-compute[80928]:   <devices>
Nov 16 05:24:57 user nova-compute[80928]:     <disk supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='diskDevice'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>disk</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cdrom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>floppy</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>lun</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='bus'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>ide</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>fdc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sata</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </disk>
Nov 16 05:24:57 user nova-compute[80928]:     <graphics supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sdl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vnc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>spice</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egl-headless</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </graphics>
Nov 16 05:24:57 user nova-compute[80928]:     <video supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='modelType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cirrus</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vmvga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>qxl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>none</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>bochs</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>ramfb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </video>
Nov 16 05:24:57 user nova-compute[80928]:     <hostdev supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='mode'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>subsystem</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='startupPolicy'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>default</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>mandatory</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>requisite</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>optional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='subsysType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pci</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='capsType'/>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='pciBackend'/>
Nov 16 05:24:57 user nova-compute[80928]:     </hostdev>
Nov 16 05:24:57 user nova-compute[80928]:     <rng supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>random</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egd</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>builtin</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </rng>
Nov 16 05:24:57 user nova-compute[80928]:     <filesystem supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='driverType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>path</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>handle</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtiofs</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </filesystem>
Nov 16 05:24:57 user nova-compute[80928]:     <tpm supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-tis</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-crb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>passthrough</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>emulator</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </tpm>
Nov 16 05:24:57 user nova-compute[80928]:   </devices>
Nov 16 05:24:57 user nova-compute[80928]:   <features>
Nov 16 05:24:57 user nova-compute[80928]:     <gic supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     <vmcoreinfo supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <genid supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backingStoreInput supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backup supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <sev supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:   </features>
Nov 16 05:24:57 user nova-compute[80928]: </domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:  {{(pid=80928) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 16 05:24:57 user nova-compute[80928]: <domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 05:24:57 user nova-compute[80928]:   <domain>kvm</domain>
Nov 16 05:24:57 user nova-compute[80928]:   <machine>pc-q35-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:   <arch>i686</arch>
Nov 16 05:24:57 user nova-compute[80928]:   <vcpu max='288'/>
Nov 16 05:24:57 user nova-compute[80928]:   <iothreads supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:   <os supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='firmware'/>
Nov 16 05:24:57 user nova-compute[80928]:     <loader supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>rom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pflash</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='readonly'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>yes</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='secure'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </loader>
Nov 16 05:24:57 user nova-compute[80928]:   </os>
Nov 16 05:24:57 user nova-compute[80928]:   <cpu>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-passthrough' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='hostPassthroughMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='maximum' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='maximumMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>on</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-model' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <vendor>Intel</vendor>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ss'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='vmx'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='pcid'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='hypervisor'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arat'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='umip'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='md-clear'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibpb'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibrs'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='erms'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='lm'/>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='custom' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>qemu64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>qemu32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>phenom</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>n270</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>kvm64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>kvm32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>coreduo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>core2duo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>athlon</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Westmere</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Snowridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Penryn</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G5</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G4</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G1</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Nehalem</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Rome</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Milan</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Dhyana</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cooperlake</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Conroe</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>486</model>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:   </cpu>
Nov 16 05:24:57 user nova-compute[80928]:   <memoryBacking supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='sourceType'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>file</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>anonymous</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>memfd</value>
Nov 16 05:24:57 user nova-compute[80928]:     </enum>
Nov 16 05:24:57 user nova-compute[80928]:   </memoryBacking>
Nov 16 05:24:57 user nova-compute[80928]:   <devices>
Nov 16 05:24:57 user nova-compute[80928]:     <disk supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='diskDevice'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>disk</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cdrom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>floppy</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>lun</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='bus'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>fdc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sata</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </disk>
Nov 16 05:24:57 user nova-compute[80928]:     <graphics supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sdl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vnc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>spice</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egl-headless</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </graphics>
Nov 16 05:24:57 user nova-compute[80928]:     <video supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='modelType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cirrus</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vmvga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>qxl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>none</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>bochs</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>ramfb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </video>
Nov 16 05:24:57 user nova-compute[80928]:     <hostdev supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='mode'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>subsystem</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='startupPolicy'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>default</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>mandatory</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>requisite</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>optional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='subsysType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pci</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='capsType'/>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='pciBackend'/>
Nov 16 05:24:57 user nova-compute[80928]:     </hostdev>
Nov 16 05:24:57 user nova-compute[80928]:     <rng supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>random</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egd</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>builtin</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </rng>
Nov 16 05:24:57 user nova-compute[80928]:     <filesystem supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='driverType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>path</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>handle</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtiofs</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </filesystem>
Nov 16 05:24:57 user nova-compute[80928]:     <tpm supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-tis</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-crb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>passthrough</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>emulator</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </tpm>
Nov 16 05:24:57 user nova-compute[80928]:   </devices>
Nov 16 05:24:57 user nova-compute[80928]:   <features>
Nov 16 05:24:57 user nova-compute[80928]:     <gic supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     <vmcoreinfo supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <genid supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backingStoreInput supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backup supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <sev supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:   </features>
Nov 16 05:24:57 user nova-compute[80928]: </domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:  {{(pid=80928) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 16 05:24:57 user nova-compute[80928]: <domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 05:24:57 user nova-compute[80928]:   <domain>kvm</domain>
Nov 16 05:24:57 user nova-compute[80928]:   <machine>pc-q35-jammy</machine>
Nov 16 05:24:57 user nova-compute[80928]:   <arch>i686</arch>
Nov 16 05:24:57 user nova-compute[80928]:   <vcpu max='288'/>
Nov 16 05:24:57 user nova-compute[80928]:   <iothreads supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:   <os supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='firmware'/>
Nov 16 05:24:57 user nova-compute[80928]:     <loader supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>rom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pflash</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='readonly'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>yes</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='secure'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </loader>
Nov 16 05:24:57 user nova-compute[80928]:   </os>
Nov 16 05:24:57 user nova-compute[80928]:   <cpu>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-passthrough' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='hostPassthroughMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='maximum' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='maximumMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>on</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-model' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <vendor>Intel</vendor>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ss'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='vmx'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='pcid'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='hypervisor'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arat'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='umip'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='md-clear'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibpb'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibrs'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='erms'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='lm'/>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='custom' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>qemu64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>qemu32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>phenom</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>n270</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>kvm64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>kvm32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>coreduo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>core2duo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>athlon</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Westmere</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Snowridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Penryn</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G5</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G4</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G1</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Nehalem</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Rome</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Milan</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Dhyana</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cooperlake</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Conroe</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>486</model>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:   </cpu>
Nov 16 05:24:57 user nova-compute[80928]:   <memoryBacking supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='sourceType'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>file</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>anonymous</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>memfd</value>
Nov 16 05:24:57 user nova-compute[80928]:     </enum>
Nov 16 05:24:57 user nova-compute[80928]:   </memoryBacking>
Nov 16 05:24:57 user nova-compute[80928]:   <devices>
Nov 16 05:24:57 user nova-compute[80928]:     <disk supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='diskDevice'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>disk</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cdrom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>floppy</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>lun</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='bus'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>fdc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sata</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </disk>
Nov 16 05:24:57 user nova-compute[80928]:     <graphics supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sdl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vnc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>spice</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egl-headless</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </graphics>
Nov 16 05:24:57 user nova-compute[80928]:     <video supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='modelType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cirrus</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vmvga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>qxl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>none</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>bochs</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>ramfb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </video>
Nov 16 05:24:57 user nova-compute[80928]:     <hostdev supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='mode'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>subsystem</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='startupPolicy'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>default</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>mandatory</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>requisite</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>optional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='subsysType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pci</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='capsType'/>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='pciBackend'/>
Nov 16 05:24:57 user nova-compute[80928]:     </hostdev>
Nov 16 05:24:57 user nova-compute[80928]:     <rng supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>random</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egd</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>builtin</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </rng>
Nov 16 05:24:57 user nova-compute[80928]:     <filesystem supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='driverType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>path</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>handle</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtiofs</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </filesystem>
Nov 16 05:24:57 user nova-compute[80928]:     <tpm supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-tis</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-crb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>passthrough</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>emulator</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </tpm>
Nov 16 05:24:57 user nova-compute[80928]:   </devices>
Nov 16 05:24:57 user nova-compute[80928]:   <features>
Nov 16 05:24:57 user nova-compute[80928]:     <gic supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     <vmcoreinfo supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <genid supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backingStoreInput supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backup supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <sev supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:   </features>
Nov 16 05:24:57 user nova-compute[80928]: </domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:  {{(pid=80928) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 16 05:24:57 user nova-compute[80928]: <domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 05:24:57 user nova-compute[80928]:   <domain>kvm</domain>
Nov 16 05:24:57 user nova-compute[80928]:   <machine>pc-i440fx-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:   <arch>i686</arch>
Nov 16 05:24:57 user nova-compute[80928]:   <vcpu max='255'/>
Nov 16 05:24:57 user nova-compute[80928]:   <iothreads supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:   <os supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='firmware'/>
Nov 16 05:24:57 user nova-compute[80928]:     <loader supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>rom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pflash</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='readonly'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>yes</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='secure'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </loader>
Nov 16 05:24:57 user nova-compute[80928]:   </os>
Nov 16 05:24:57 user nova-compute[80928]:   <cpu>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-passthrough' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='hostPassthroughMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='maximum' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='maximumMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>on</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-model' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <vendor>Intel</vendor>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ss'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='vmx'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='pcid'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='hypervisor'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arat'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='umip'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='md-clear'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibpb'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibrs'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='erms'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='lm'/>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='custom' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>qemu64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>qemu32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>phenom</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>n270</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>kvm64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>kvm32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>coreduo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>core2duo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>athlon</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Westmere</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Snowridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Penryn</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G5</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G4</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G1</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Nehalem</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Rome</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Milan</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Dhyana</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cooperlake</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Conroe</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>486</model>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:   </cpu>
Nov 16 05:24:57 user nova-compute[80928]:   <memoryBacking supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='sourceType'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>file</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>anonymous</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>memfd</value>
Nov 16 05:24:57 user nova-compute[80928]:     </enum>
Nov 16 05:24:57 user nova-compute[80928]:   </memoryBacking>
Nov 16 05:24:57 user nova-compute[80928]:   <devices>
Nov 16 05:24:57 user nova-compute[80928]:     <disk supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='diskDevice'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>disk</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cdrom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>floppy</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>lun</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='bus'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>ide</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>fdc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sata</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </disk>
Nov 16 05:24:57 user nova-compute[80928]:     <graphics supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sdl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vnc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>spice</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egl-headless</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </graphics>
Nov 16 05:24:57 user nova-compute[80928]:     <video supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='modelType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cirrus</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vmvga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>qxl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>none</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>bochs</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>ramfb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </video>
Nov 16 05:24:57 user nova-compute[80928]:     <hostdev supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='mode'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>subsystem</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='startupPolicy'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>default</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>mandatory</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>requisite</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>optional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='subsysType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pci</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='capsType'/>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='pciBackend'/>
Nov 16 05:24:57 user nova-compute[80928]:     </hostdev>
Nov 16 05:24:57 user nova-compute[80928]:     <rng supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>random</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egd</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>builtin</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </rng>
Nov 16 05:24:57 user nova-compute[80928]:     <filesystem supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='driverType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>path</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>handle</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtiofs</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </filesystem>
Nov 16 05:24:57 user nova-compute[80928]:     <tpm supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-tis</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-crb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>passthrough</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>emulator</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </tpm>
Nov 16 05:24:57 user nova-compute[80928]:   </devices>
Nov 16 05:24:57 user nova-compute[80928]:   <features>
Nov 16 05:24:57 user nova-compute[80928]:     <gic supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     <vmcoreinfo supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <genid supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backingStoreInput supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backup supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <sev supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:   </features>
Nov 16 05:24:57 user nova-compute[80928]: </domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:  {{(pid=80928) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 16 05:24:57 user nova-compute[80928]: <domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 05:24:57 user nova-compute[80928]:   <domain>kvm</domain>
Nov 16 05:24:57 user nova-compute[80928]:   <machine>pc-i440fx-jammy</machine>
Nov 16 05:24:57 user nova-compute[80928]:   <arch>x86_64</arch>
Nov 16 05:24:57 user nova-compute[80928]:   <vcpu max='255'/>
Nov 16 05:24:57 user nova-compute[80928]:   <iothreads supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:   <os supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='firmware'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>efi</value>
Nov 16 05:24:57 user nova-compute[80928]:     </enum>
Nov 16 05:24:57 user nova-compute[80928]:     <loader supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>rom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pflash</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='readonly'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>yes</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='secure'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </loader>
Nov 16 05:24:57 user nova-compute[80928]:   </os>
Nov 16 05:24:57 user nova-compute[80928]:   <cpu>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-passthrough' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='hostPassthroughMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>on</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='maximum' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='maximumMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>on</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-model' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <vendor>Intel</vendor>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ss'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='vmx'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='pcid'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='hypervisor'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arat'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='umip'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='md-clear'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='invtsc'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibpb'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibrs'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='rsba'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='erms'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='custom' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>qemu64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>qemu32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>phenom</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>n270</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>kvm64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>kvm32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>coreduo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>core2duo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>athlon</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Westmere</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Snowridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Penryn</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G5</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G4</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Opteron_G1</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Nehalem</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Rome</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Milan</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Dhyana</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cooperlake</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Conroe</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>486</model>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:   </cpu>
Nov 16 05:24:57 user nova-compute[80928]:   <memoryBacking supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='sourceType'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>file</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>anonymous</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>memfd</value>
Nov 16 05:24:57 user nova-compute[80928]:     </enum>
Nov 16 05:24:57 user nova-compute[80928]:   </memoryBacking>
Nov 16 05:24:57 user nova-compute[80928]:   <devices>
Nov 16 05:24:57 user nova-compute[80928]:     <disk supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='diskDevice'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>disk</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cdrom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>floppy</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>lun</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='bus'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>ide</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>fdc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sata</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </disk>
Nov 16 05:24:57 user nova-compute[80928]:     <graphics supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sdl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vnc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>spice</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egl-headless</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </graphics>
Nov 16 05:24:57 user nova-compute[80928]:     <video supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='modelType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cirrus</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vmvga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>qxl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>none</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>bochs</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>ramfb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </video>
Nov 16 05:24:57 user nova-compute[80928]:     <hostdev supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='mode'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>subsystem</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='startupPolicy'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>default</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>mandatory</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>requisite</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>optional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='subsysType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pci</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='capsType'/>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='pciBackend'/>
Nov 16 05:24:57 user nova-compute[80928]:     </hostdev>
Nov 16 05:24:57 user nova-compute[80928]:     <rng supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>random</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egd</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>builtin</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </rng>
Nov 16 05:24:57 user nova-compute[80928]:     <filesystem supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='driverType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>path</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>handle</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtiofs</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </filesystem>
Nov 16 05:24:57 user nova-compute[80928]:     <tpm supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-tis</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-crb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>passthrough</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>emulator</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </tpm>
Nov 16 05:24:57 user nova-compute[80928]:   </devices>
Nov 16 05:24:57 user nova-compute[80928]:   <features>
Nov 16 05:24:57 user nova-compute[80928]:     <gic supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     <vmcoreinfo supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <genid supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backingStoreInput supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backup supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <sev supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:   </features>
Nov 16 05:24:57 user nova-compute[80928]: </domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:  {{(pid=80928) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 16 05:24:57 user nova-compute[80928]: <domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 05:24:57 user nova-compute[80928]:   <domain>kvm</domain>
Nov 16 05:24:57 user nova-compute[80928]:   <machine>pc-q35-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:   <arch>x86_64</arch>
Nov 16 05:24:57 user nova-compute[80928]:   <vcpu max='288'/>
Nov 16 05:24:57 user nova-compute[80928]:   <iothreads supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:   <os supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='firmware'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>efi</value>
Nov 16 05:24:57 user nova-compute[80928]:     </enum>
Nov 16 05:24:57 user nova-compute[80928]:     <loader supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>rom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pflash</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='readonly'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>yes</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='secure'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>yes</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </loader>
Nov 16 05:24:57 user nova-compute[80928]:   </os>
Nov 16 05:24:57 user nova-compute[80928]:   <cpu>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-passthrough' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='hostPassthroughMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>on</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='maximum' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='maximumMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>on</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-model' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <vendor>Intel</vendor>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ss'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='vmx'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='pcid'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='hypervisor'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arat'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='umip'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='md-clear'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='invtsc'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibpb'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibrs'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='rsba'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='erms'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='custom' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>qemu64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>qemu32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>phenom</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>n270</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>kvm64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>kvm32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>coreduo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>core2duo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>athlon</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Westmere</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Snowridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Penryn</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G5</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G4</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Opteron_G1</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Nehalem</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Rome</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Milan</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Dhyana</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cooperlake</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Conroe</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>486</model>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:   </cpu>
Nov 16 05:24:57 user nova-compute[80928]:   <memoryBacking supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='sourceType'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>file</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>anonymous</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>memfd</value>
Nov 16 05:24:57 user nova-compute[80928]:     </enum>
Nov 16 05:24:57 user nova-compute[80928]:   </memoryBacking>
Nov 16 05:24:57 user nova-compute[80928]:   <devices>
Nov 16 05:24:57 user nova-compute[80928]:     <disk supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='diskDevice'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>disk</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cdrom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>floppy</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>lun</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='bus'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>fdc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sata</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </disk>
Nov 16 05:24:57 user nova-compute[80928]:     <graphics supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sdl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vnc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>spice</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egl-headless</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </graphics>
Nov 16 05:24:57 user nova-compute[80928]:     <video supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='modelType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cirrus</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vmvga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>qxl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>none</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>bochs</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>ramfb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </video>
Nov 16 05:24:57 user nova-compute[80928]:     <hostdev supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='mode'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>subsystem</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='startupPolicy'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>default</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>mandatory</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>requisite</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>optional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='subsysType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pci</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='capsType'/>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='pciBackend'/>
Nov 16 05:24:57 user nova-compute[80928]:     </hostdev>
Nov 16 05:24:57 user nova-compute[80928]:     <rng supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>random</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egd</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>builtin</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </rng>
Nov 16 05:24:57 user nova-compute[80928]:     <filesystem supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='driverType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>path</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>handle</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtiofs</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </filesystem>
Nov 16 05:24:57 user nova-compute[80928]:     <tpm supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-tis</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-crb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>passthrough</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>emulator</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </tpm>
Nov 16 05:24:57 user nova-compute[80928]:   </devices>
Nov 16 05:24:57 user nova-compute[80928]:   <features>
Nov 16 05:24:57 user nova-compute[80928]:     <gic supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     <vmcoreinfo supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <genid supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backingStoreInput supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backup supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <sev supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:   </features>
Nov 16 05:24:57 user nova-compute[80928]: </domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:  {{(pid=80928) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 16 05:24:57 user nova-compute[80928]: <domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 05:24:57 user nova-compute[80928]:   <domain>kvm</domain>
Nov 16 05:24:57 user nova-compute[80928]:   <machine>pc-q35-jammy</machine>
Nov 16 05:24:57 user nova-compute[80928]:   <arch>x86_64</arch>
Nov 16 05:24:57 user nova-compute[80928]:   <vcpu max='288'/>
Nov 16 05:24:57 user nova-compute[80928]:   <iothreads supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:   <os supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='firmware'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>efi</value>
Nov 16 05:24:57 user nova-compute[80928]:     </enum>
Nov 16 05:24:57 user nova-compute[80928]:     <loader supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>rom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pflash</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='readonly'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>yes</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='secure'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>yes</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </loader>
Nov 16 05:24:57 user nova-compute[80928]:   </os>
Nov 16 05:24:57 user nova-compute[80928]:   <cpu>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-passthrough' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='hostPassthroughMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>on</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='maximum' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='maximumMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>on</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-model' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <vendor>Intel</vendor>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ss'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='vmx'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='pcid'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='hypervisor'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arat'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='umip'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='md-clear'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='invtsc'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibpb'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibrs'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='rsba'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='erms'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='custom' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>qemu64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>qemu32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>phenom</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>n270</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>kvm64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>kvm32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>coreduo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>core2duo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>athlon</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Westmere</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Snowridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Penryn</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G5</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G4</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Opteron_G1</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Nehalem</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Rome</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Milan</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Dhyana</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cooperlake</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Conroe</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>486</model>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:   </cpu>
Nov 16 05:24:57 user nova-compute[80928]:   <memoryBacking supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='sourceType'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>file</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>anonymous</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>memfd</value>
Nov 16 05:24:57 user nova-compute[80928]:     </enum>
Nov 16 05:24:57 user nova-compute[80928]:   </memoryBacking>
Nov 16 05:24:57 user nova-compute[80928]:   <devices>
Nov 16 05:24:57 user nova-compute[80928]:     <disk supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='diskDevice'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>disk</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cdrom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>floppy</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>lun</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='bus'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>fdc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sata</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </disk>
Nov 16 05:24:57 user nova-compute[80928]:     <graphics supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sdl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vnc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>spice</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egl-headless</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </graphics>
Nov 16 05:24:57 user nova-compute[80928]:     <video supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='modelType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cirrus</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vmvga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>qxl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>none</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>bochs</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>ramfb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </video>
Nov 16 05:24:57 user nova-compute[80928]:     <hostdev supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='mode'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>subsystem</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='startupPolicy'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>default</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>mandatory</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>requisite</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>optional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='subsysType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pci</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='capsType'/>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='pciBackend'/>
Nov 16 05:24:57 user nova-compute[80928]:     </hostdev>
Nov 16 05:24:57 user nova-compute[80928]:     <rng supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>random</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egd</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>builtin</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </rng>
Nov 16 05:24:57 user nova-compute[80928]:     <filesystem supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='driverType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>path</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>handle</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtiofs</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </filesystem>
Nov 16 05:24:57 user nova-compute[80928]:     <tpm supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-tis</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-crb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>passthrough</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>emulator</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </tpm>
Nov 16 05:24:57 user nova-compute[80928]:   </devices>
Nov 16 05:24:57 user nova-compute[80928]:   <features>
Nov 16 05:24:57 user nova-compute[80928]:     <gic supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     <vmcoreinfo supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <genid supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backingStoreInput supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backup supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <sev supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:   </features>
Nov 16 05:24:57 user nova-compute[80928]: </domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:  {{(pid=80928) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 16 05:24:57 user nova-compute[80928]: <domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 05:24:57 user nova-compute[80928]:   <domain>kvm</domain>
Nov 16 05:24:57 user nova-compute[80928]:   <machine>pc-i440fx-6.2</machine>
Nov 16 05:24:57 user nova-compute[80928]:   <arch>x86_64</arch>
Nov 16 05:24:57 user nova-compute[80928]:   <vcpu max='255'/>
Nov 16 05:24:57 user nova-compute[80928]:   <iothreads supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:   <os supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='firmware'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>efi</value>
Nov 16 05:24:57 user nova-compute[80928]:     </enum>
Nov 16 05:24:57 user nova-compute[80928]:     <loader supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>rom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pflash</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='readonly'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>yes</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='secure'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>no</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </loader>
Nov 16 05:24:57 user nova-compute[80928]:   </os>
Nov 16 05:24:57 user nova-compute[80928]:   <cpu>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-passthrough' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='hostPassthroughMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>on</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='maximum' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='maximumMigratable'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>on</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>off</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='host-model' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <vendor>Intel</vendor>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ss'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='vmx'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='pcid'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='hypervisor'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arat'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='umip'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='md-clear'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='invtsc'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibpb'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='ibrs'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-stibp'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='rsba'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='erms'/>
Nov 16 05:24:57 user nova-compute[80928]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:     <mode name='custom' supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>qemu64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>qemu32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>phenom</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>pentium</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>n270</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>kvm64</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>kvm32</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>coreduo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>core2duo</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>athlon</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Westmere</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Snowridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Skylake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>SandyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Penryn</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G5</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G4</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G3</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Opteron_G2</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Opteron_G1</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Nehalem</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>IvyBridge</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Icelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Haswell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Rome</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-Milan</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>EPYC</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Dhyana</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cooperlake</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>Conroe</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='no'>Broadwell</model>
Nov 16 05:24:57 user nova-compute[80928]:       <model usable='yes'>486</model>
Nov 16 05:24:57 user nova-compute[80928]:     </mode>
Nov 16 05:24:57 user nova-compute[80928]:   </cpu>
Nov 16 05:24:57 user nova-compute[80928]:   <memoryBacking supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:     <enum name='sourceType'>
Nov 16 05:24:57 user nova-compute[80928]:       <value>file</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>anonymous</value>
Nov 16 05:24:57 user nova-compute[80928]:       <value>memfd</value>
Nov 16 05:24:57 user nova-compute[80928]:     </enum>
Nov 16 05:24:57 user nova-compute[80928]:   </memoryBacking>
Nov 16 05:24:57 user nova-compute[80928]:   <devices>
Nov 16 05:24:57 user nova-compute[80928]:     <disk supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='diskDevice'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>disk</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cdrom</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>floppy</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>lun</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='bus'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>ide</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>fdc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sata</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </disk>
Nov 16 05:24:57 user nova-compute[80928]:     <graphics supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='type'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>sdl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vnc</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>spice</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egl-headless</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </graphics>
Nov 16 05:24:57 user nova-compute[80928]:     <video supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='modelType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>cirrus</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>vmvga</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>qxl</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>none</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>bochs</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>ramfb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </video>
Nov 16 05:24:57 user nova-compute[80928]:     <hostdev supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='mode'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>subsystem</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='startupPolicy'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>default</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>mandatory</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>requisite</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>optional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='subsysType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>usb</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>pci</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>scsi</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='capsType'/>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='pciBackend'/>
Nov 16 05:24:57 user nova-compute[80928]:     </hostdev>
Nov 16 05:24:57 user nova-compute[80928]:     <rng supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtio-non-transitional</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>random</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>egd</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>builtin</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </rng>
Nov 16 05:24:57 user nova-compute[80928]:     <filesystem supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='driverType'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>path</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>handle</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>virtiofs</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </filesystem>
Nov 16 05:24:57 user nova-compute[80928]:     <tpm supported='yes'>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='model'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-tis</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>tpm-crb</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:       <enum name='backendModel'>
Nov 16 05:24:57 user nova-compute[80928]:         <value>passthrough</value>
Nov 16 05:24:57 user nova-compute[80928]:         <value>emulator</value>
Nov 16 05:24:57 user nova-compute[80928]:       </enum>
Nov 16 05:24:57 user nova-compute[80928]:     </tpm>
Nov 16 05:24:57 user nova-compute[80928]:   </devices>
Nov 16 05:24:57 user nova-compute[80928]:   <features>
Nov 16 05:24:57 user nova-compute[80928]:     <gic supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:     <vmcoreinfo supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <genid supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backingStoreInput supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <backup supported='yes'/>
Nov 16 05:24:57 user nova-compute[80928]:     <sev supported='no'/>
Nov 16 05:24:57 user nova-compute[80928]:   </features>
Nov 16 05:24:57 user nova-compute[80928]: </domainCapabilities>
Nov 16 05:24:57 user nova-compute[80928]:  {{(pid=80928) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=80928) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=80928) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Checking secure boot support for host arch (x86_64) {{(pid=80928) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Checking secure boot support for host arch (x86_64) {{(pid=80928) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Checking secure boot support for host arch (x86_64) {{(pid=80928) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 05:24:57 user nova-compute[80928]: INFO nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Secure Boot support detected
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] cpu compare xml: <cpu match="exact">
Nov 16 05:24:57 user nova-compute[80928]:   <model>Nehalem</model>
Nov 16 05:24:57 user nova-compute[80928]: </cpu>
Nov 16 05:24:57 user nova-compute[80928]:  {{(pid=80928) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 16 05:24:57 user nova-compute[80928]: INFO nova.virt.node [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Generated node identity 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e
Nov 16 05:24:57 user nova-compute[80928]: INFO nova.virt.node [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Wrote node identity 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e to /opt/stack/data/nova/compute_id
Nov 16 05:24:57 user nova-compute[80928]: WARNING nova.compute.manager [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Compute nodes ['7c2bca45-4d73-4fca-baf6-06c1e78dcd4e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 16 05:24:57 user nova-compute[80928]: INFO nova.compute.manager [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 16 05:24:57 user nova-compute[80928]: WARNING nova.compute.manager [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 05:24:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:24:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:24:58 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:24:58 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Hypervisor/Node resource view: name=user free_ram=10951MB free_disk=26.333236694335938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:24:58 user nova-compute[80928]: WARNING nova.compute.resource_tracker [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] No compute node record for user:7c2bca45-4d73-4fca-baf6-06c1e78dcd4e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e could not be found.
Nov 16 05:24:58 user nova-compute[80928]: INFO nova.compute.resource_tracker [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Compute node record created for user:user with uuid: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:24:58 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] [req-d3fb63c5-0fd7-4798-820a-e1628c82e89a] Created resource provider record via placement API for resource provider with UUID 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e and name user.
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=80928) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 16 05:24:58 user nova-compute[80928]: INFO nova.virt.libvirt.host [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] kernel doesn't support AMD SEV
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Libvirt baseline CPU <cpu>
Nov 16 05:24:58 user nova-compute[80928]:   <arch>x86_64</arch>
Nov 16 05:24:58 user nova-compute[80928]:   <model>Nehalem</model>
Nov 16 05:24:58 user nova-compute[80928]:   <vendor>Intel</vendor>
Nov 16 05:24:58 user nova-compute[80928]:   <topology sockets="6" cores="1" threads="1"/>
Nov 16 05:24:58 user nova-compute[80928]: </cpu>
Nov 16 05:24:58 user nova-compute[80928]:  {{(pid=80928) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Updated inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Updating resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e generation from 0 to 1 during operation: update_inventory {{(pid=80928) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Updating resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e generation from 1 to 2 during operation: update_traits {{(pid=80928) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.service [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Creating RPC server for service compute {{(pid=80928) start /opt/stack/nova/nova/service.py:182}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.service [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] Join ServiceGroup membership for this service compute {{(pid=80928) start /opt/stack/nova/nova/service.py:199}}
Nov 16 05:24:58 user nova-compute[80928]: DEBUG nova.servicegroup.drivers.db [None req-ae613356-9ea3-46e2-965f-08348d733759 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=80928) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 16 05:25:36 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_power_states {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:25:36 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:25:49 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:25:50 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:25:50 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:25:50 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=10362MB free_disk=26.24469757080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:25:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:25:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:25:50 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:25:50 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:25:50 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:25:50 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:25:50 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:25:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:26:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:26:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:26:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:26:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:26:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:26:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 05:26:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 05:26:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:26:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:26:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:26:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:26:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:26:51 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:26:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:26:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:26:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:26:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:26:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:26:52 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:26:52 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:26:52 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=10285MB free_disk=26.309070587158203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:26:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:26:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:26:52 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:26:52 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:26:52 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:26:52 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:26:52 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:26:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:27:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:27:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:27:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:27:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:27:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:27:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:27:52 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:27:52 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 05:27:52 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 05:27:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:27:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:27:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:27:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:27:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:27:52 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:27:53 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:27:53 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:27:53 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=10330MB free_disk=26.06146240234375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:27:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:27:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:27:53 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:27:53 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:27:53 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:27:53 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:27:53 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:27:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:27:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:27:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:28:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:28:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:28:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:28:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:28:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:28:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:28:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:28:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:28:52 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:28:53 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:28:53 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:28:53 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=9608MB free_disk=26.081607818603516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:28:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:53 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:28:53 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:28:53 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:28:53 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:28:53 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:28:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:28:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:28:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:28:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:28:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 05:28:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 05:28:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "8292134f-09d4-4240-94bb-281e6c236d09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "8292134f-09d4-4240-94bb-281e6c236d09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:28:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:28:55 user nova-compute[80928]: INFO nova.compute.claims [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Claim successful on node user
Nov 16 05:28:55 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:28:55 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:28:55 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:28:55 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:28:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:28:55 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "5d03bda0-20b8-497a-a87b-faee21624468" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "5d03bda0-20b8-497a-a87b-faee21624468" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:28:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:28:56 user nova-compute[80928]: INFO nova.compute.claims [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Claim successful on node user
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:28:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Creating image(s)
Nov 16 05:28:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "/opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "/opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "/opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:28:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:28:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176.part --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG nova.policy [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b904db715308497cbd24bfd51a34d0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a972c7cdc45e79d788c35ac613b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG nova.policy [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bb9af29de44488282666171f2bcad47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995121e71e234f60b7f7d5ac0abcc0f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176.part --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG nova.virt.images [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] c747fce3-6158-4d78-9cb4-34afacae8f7a was qcow2, converting to raw {{(pid=80928) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176.part /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176.converted {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:28:57 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Creating image(s)
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "/opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "/opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176.part /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176.converted" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176.converted --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.302s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:28:57 user nova-compute[80928]: INFO oslo.privsep.daemon [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzng93mbo/privsep.sock']
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.340s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:28:57 user sudo[90408]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzng93mbo/privsep.sock
Nov 16 05:28:57 user sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 05:28:59 user sudo[90408]: pam_unix(sudo:session): session closed for user root
Nov 16 05:28:59 user nova-compute[80928]: INFO oslo.privsep.daemon [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Spawned new privsep daemon via rootwrap
Nov 16 05:28:59 user nova-compute[80928]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 05:28:59 user nova-compute[80928]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 05:28:59 user nova-compute[80928]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 16 05:28:59 user nova-compute[80928]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90417
Nov 16 05:28:59 user nova-compute[80928]: WARNING oslo_privsep.priv_context [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] privsep daemon already running
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.211s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.230s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "983eadda-f7cc-410c-91b5-62082cefe9ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk 1073741824" returned: 0 in 0.042s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Successfully created port: b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.195s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:28:59 user nova-compute[80928]: INFO nova.compute.claims [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Claim successful on node user
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk 1073741824" returned: 0 in 0.072s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:28:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Successfully created port: 7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Cannot resize image /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Ensure instance console log exists: /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.200s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.network.neutron [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:29:00 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Cannot resize image /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Ensure instance console log exists: /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:29:00 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Creating image(s)
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "/opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "/opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "/opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG nova.policy [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a72a860e8214b51bb1111442dee406d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416ba3a5f17c4673bf6ea5bad9be09b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk 1073741824" returned: 0 in 0.048s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.217s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Cannot resize image /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Ensure instance console log exists: /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "762caa99-5c4a-428d-8059-7903d0bdb149" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "762caa99-5c4a-428d-8059-7903d0bdb149" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:29:02 user nova-compute[80928]: INFO nova.compute.claims [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Claim successful on node user
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.054s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:29:02 user nova-compute[80928]: INFO nova.compute.claims [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Claim successful on node user
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:29:02 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Successfully updated port: b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquired lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:29:02 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Creating image(s)
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "/opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "/opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "/opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.policy [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b1697de2fd04b27bc89ec6430a8a51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9684eff8dae04ceeb858555284d27e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Successfully created port: 116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:29:02 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:29:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk 1073741824" returned: 0 in 0.047s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:29:03 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Creating image(s)
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "/opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "/opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "/opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-853bcaf9-113b-4bc9-a0e4-245de78bd3f0 req-28ce7bd5-e5f7-42c0-af24-175189db89a7 service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Received event network-changed-b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-853bcaf9-113b-4bc9-a0e4-245de78bd3f0 req-28ce7bd5-e5f7-42c0-af24-175189db89a7 service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Refreshing instance network info cache due to event network-changed-b4c13900-ad26-495d-b3e6-c791298f31fd. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-853bcaf9-113b-4bc9-a0e4-245de78bd3f0 req-28ce7bd5-e5f7-42c0-af24-175189db89a7 service nova] Acquiring lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.policy [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '952a7ea7e63649259b0b1e0df40c97d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f585dcb9e6cb432a9b04526ebc30e9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Successfully updated port: 7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "refresh_cache-5d03bda0-20b8-497a-a87b-faee21624468" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquired lock "refresh_cache-5d03bda0-20b8-497a-a87b-faee21624468" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.198s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.202s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Cannot resize image /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Ensure instance console log exists: /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk 1073741824" returned: 0 in 0.056s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.234s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Cannot resize image /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Ensure instance console log exists: /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Updating instance_info_cache with network_info: [{"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Releasing lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Instance network_info: |[{"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-853bcaf9-113b-4bc9-a0e4-245de78bd3f0 req-28ce7bd5-e5f7-42c0-af24-175189db89a7 service nova] Acquired lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.network.neutron [req-853bcaf9-113b-4bc9-a0e4-245de78bd3f0 req-28ce7bd5-e5f7-42c0-af24-175189db89a7 service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Refreshing network info cache for port b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Start _get_guest_xml network_info=[{"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:29:04 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:04 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1619627102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1619627102',id=1,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-46kx7cjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:28:56Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=8292134f-09d4-4240-94bb-281e6c236d09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:76:b1,bridge_name='br-int',has_traffic_filtering=True,id=b4c13900-ad26-495d-b3e6-c791298f31fd,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c13900-ad') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'pci_devices' on Instance uuid 8292134f-09d4-4240-94bb-281e6c236d09 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:29:04 user nova-compute[80928]:   <uuid>8292134f-09d4-4240-94bb-281e6c236d09</uuid>
Nov 16 05:29:04 user nova-compute[80928]:   <name>instance-00000001</name>
Nov 16 05:29:04 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:29:04 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:29:04 user nova-compute[80928]:   <metadata>
Nov 16 05:29:04 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:29:04 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:29:04 user nova-compute[80928]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1619627102</nova:name>
Nov 16 05:29:04 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:29:04</nova:creationTime>
Nov 16 05:29:04 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:29:04 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:29:04 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:29:04 user nova-compute[80928]:       <nova:owner>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:user uuid="3bb9af29de44488282666171f2bcad47">tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member</nova:user>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:project uuid="995121e71e234f60b7f7d5ac0abcc0f1">tempest-ServerBootFromVolumeStableRescueTest-1026359285</nova:project>
Nov 16 05:29:04 user nova-compute[80928]:       </nova:owner>
Nov 16 05:29:04 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:29:04 user nova-compute[80928]:       <nova:ports>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:port uuid="b4c13900-ad26-495d-b3e6-c791298f31fd">
Nov 16 05:29:04 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 05:29:04 user nova-compute[80928]:         </nova:port>
Nov 16 05:29:04 user nova-compute[80928]:       </nova:ports>
Nov 16 05:29:04 user nova-compute[80928]:     </nova:instance>
Nov 16 05:29:04 user nova-compute[80928]:   </metadata>
Nov 16 05:29:04 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:29:04 user nova-compute[80928]:     <system>
Nov 16 05:29:04 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:29:04 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:29:04 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:29:04 user nova-compute[80928]:       <entry name="serial">8292134f-09d4-4240-94bb-281e6c236d09</entry>
Nov 16 05:29:04 user nova-compute[80928]:       <entry name="uuid">8292134f-09d4-4240-94bb-281e6c236d09</entry>
Nov 16 05:29:04 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:29:04 user nova-compute[80928]:     </system>
Nov 16 05:29:04 user nova-compute[80928]:   </sysinfo>
Nov 16 05:29:04 user nova-compute[80928]:   <os>
Nov 16 05:29:04 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:29:04 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:29:04 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:29:04 user nova-compute[80928]:   </os>
Nov 16 05:29:04 user nova-compute[80928]:   <features>
Nov 16 05:29:04 user nova-compute[80928]:     <acpi/>
Nov 16 05:29:04 user nova-compute[80928]:     <apic/>
Nov 16 05:29:04 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:29:04 user nova-compute[80928]:   </features>
Nov 16 05:29:04 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:29:04 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:29:04 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:29:04 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:29:04 user nova-compute[80928]:   </clock>
Nov 16 05:29:04 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:29:04 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:29:04 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:29:04 user nova-compute[80928]:   </cpu>
Nov 16 05:29:04 user nova-compute[80928]:   <devices>
Nov 16 05:29:04 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:29:04 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:29:04 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk"/>
Nov 16 05:29:04 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:29:04 user nova-compute[80928]:     </disk>
Nov 16 05:29:04 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:29:04 user nova-compute[80928]:       <mac address="fa:16:3e:6c:76:b1"/>
Nov 16 05:29:04 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:04 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:29:04 user nova-compute[80928]:       <target dev="tapb4c13900-ad"/>
Nov 16 05:29:04 user nova-compute[80928]:     </interface>
Nov 16 05:29:04 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:29:04 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/console.log" append="off"/>
Nov 16 05:29:04 user nova-compute[80928]:     </serial>
Nov 16 05:29:04 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:29:04 user nova-compute[80928]:     <video>
Nov 16 05:29:04 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:04 user nova-compute[80928]:     </video>
Nov 16 05:29:04 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:29:04 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:29:04 user nova-compute[80928]:     </rng>
Nov 16 05:29:04 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:29:04 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:29:04 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:29:04 user nova-compute[80928]:     </memballoon>
Nov 16 05:29:04 user nova-compute[80928]:   </devices>
Nov 16 05:29:04 user nova-compute[80928]: </domain>
Nov 16 05:29:04 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1619627102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1619627102',id=1,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-46kx7cjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:28:56Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=8292134f-09d4-4240-94bb-281e6c236d09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:76:b1,bridge_name='br-int',has_traffic_filtering=True,id=b4c13900-ad26-495d-b3e6-c791298f31fd,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c13900-ad') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG os_vif [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:76:b1,bridge_name='br-int',has_traffic_filtering=True,id=b4c13900-ad26-495d-b3e6-c791298f31fd,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c13900-ad') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Created schema index Interface.name {{(pid=80928) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Created schema index Port.name {{(pid=80928) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Created schema index Bridge.name {{(pid=80928) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [POLLOUT] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82985f5b-a712-5022-af73-aa5697900a40', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:04 user nova-compute[80928]: INFO oslo.privsep.daemon [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp7ob_f38o/privsep.sock']
Nov 16 05:29:04 user sudo[90500]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp7ob_f38o/privsep.sock
Nov 16 05:29:04 user sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Updating instance_info_cache with network_info: [{"id": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "address": "fa:16:3e:57:d0:dd", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af67efa-d1", "ovs_interfaceid": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Releasing lock "refresh_cache-5d03bda0-20b8-497a-a87b-faee21624468" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Instance network_info: |[{"id": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "address": "fa:16:3e:57:d0:dd", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af67efa-d1", "ovs_interfaceid": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Start _get_guest_xml network_info=[{"id": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "address": "fa:16:3e:57:d0:dd", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af67efa-d1", "ovs_interfaceid": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:29:04 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:04 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1710517253',display_name='tempest-ServersNegativeTestJSON-server-1710517253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1710517253',id=2,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b31a972c7cdc45e79d788c35ac613b0e',ramdisk_id='',reservation_id='r-0s5yddcg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1596712159',owner_user_name='tempest-ServersNegativeTestJSON-1596712159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:28:57Z,user_data=None,user_id='b904db715308497cbd24bfd51a34d0f9',uuid=5d03bda0-20b8-497a-a87b-faee21624468,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "address": "fa:16:3e:57:d0:dd", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af67efa-d1", "ovs_interfaceid": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Converting VIF {"id": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "address": "fa:16:3e:57:d0:dd", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af67efa-d1", "ovs_interfaceid": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d0:dd,bridge_name='br-int',has_traffic_filtering=True,id=7af67efa-d198-4abd-bbdf-a73cf48b7c43,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af67efa-d1') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d03bda0-20b8-497a-a87b-faee21624468 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:29:04 user nova-compute[80928]:   <uuid>5d03bda0-20b8-497a-a87b-faee21624468</uuid>
Nov 16 05:29:04 user nova-compute[80928]:   <name>instance-00000002</name>
Nov 16 05:29:04 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:29:04 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:29:04 user nova-compute[80928]:   <metadata>
Nov 16 05:29:04 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:29:04 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:29:04 user nova-compute[80928]:       <nova:name>tempest-ServersNegativeTestJSON-server-1710517253</nova:name>
Nov 16 05:29:04 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:29:04</nova:creationTime>
Nov 16 05:29:04 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:29:04 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:29:04 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:29:04 user nova-compute[80928]:       <nova:owner>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:user uuid="b904db715308497cbd24bfd51a34d0f9">tempest-ServersNegativeTestJSON-1596712159-project-member</nova:user>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:project uuid="b31a972c7cdc45e79d788c35ac613b0e">tempest-ServersNegativeTestJSON-1596712159</nova:project>
Nov 16 05:29:04 user nova-compute[80928]:       </nova:owner>
Nov 16 05:29:04 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:29:04 user nova-compute[80928]:       <nova:ports>
Nov 16 05:29:04 user nova-compute[80928]:         <nova:port uuid="7af67efa-d198-4abd-bbdf-a73cf48b7c43">
Nov 16 05:29:04 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 05:29:04 user nova-compute[80928]:         </nova:port>
Nov 16 05:29:04 user nova-compute[80928]:       </nova:ports>
Nov 16 05:29:04 user nova-compute[80928]:     </nova:instance>
Nov 16 05:29:04 user nova-compute[80928]:   </metadata>
Nov 16 05:29:04 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:29:04 user nova-compute[80928]:     <system>
Nov 16 05:29:04 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:29:04 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:29:04 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:29:04 user nova-compute[80928]:       <entry name="serial">5d03bda0-20b8-497a-a87b-faee21624468</entry>
Nov 16 05:29:04 user nova-compute[80928]:       <entry name="uuid">5d03bda0-20b8-497a-a87b-faee21624468</entry>
Nov 16 05:29:04 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:29:04 user nova-compute[80928]:     </system>
Nov 16 05:29:04 user nova-compute[80928]:   </sysinfo>
Nov 16 05:29:04 user nova-compute[80928]:   <os>
Nov 16 05:29:04 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:29:04 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:29:04 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:29:04 user nova-compute[80928]:   </os>
Nov 16 05:29:04 user nova-compute[80928]:   <features>
Nov 16 05:29:04 user nova-compute[80928]:     <acpi/>
Nov 16 05:29:04 user nova-compute[80928]:     <apic/>
Nov 16 05:29:04 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:29:04 user nova-compute[80928]:   </features>
Nov 16 05:29:04 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:29:04 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:29:04 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:29:04 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:29:04 user nova-compute[80928]:   </clock>
Nov 16 05:29:04 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:29:04 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:29:04 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:29:04 user nova-compute[80928]:   </cpu>
Nov 16 05:29:04 user nova-compute[80928]:   <devices>
Nov 16 05:29:04 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:29:04 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:29:04 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk"/>
Nov 16 05:29:04 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:29:04 user nova-compute[80928]:     </disk>
Nov 16 05:29:04 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:29:04 user nova-compute[80928]:       <mac address="fa:16:3e:57:d0:dd"/>
Nov 16 05:29:04 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:04 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:29:04 user nova-compute[80928]:       <target dev="tap7af67efa-d1"/>
Nov 16 05:29:04 user nova-compute[80928]:     </interface>
Nov 16 05:29:04 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:29:04 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/console.log" append="off"/>
Nov 16 05:29:04 user nova-compute[80928]:     </serial>
Nov 16 05:29:04 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:29:04 user nova-compute[80928]:     <video>
Nov 16 05:29:04 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:04 user nova-compute[80928]:     </video>
Nov 16 05:29:04 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:29:04 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:29:04 user nova-compute[80928]:     </rng>
Nov 16 05:29:04 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:29:04 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:29:04 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:29:04 user nova-compute[80928]:     </memballoon>
Nov 16 05:29:04 user nova-compute[80928]:   </devices>
Nov 16 05:29:04 user nova-compute[80928]: </domain>
Nov 16 05:29:04 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1710517253',display_name='tempest-ServersNegativeTestJSON-server-1710517253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1710517253',id=2,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b31a972c7cdc45e79d788c35ac613b0e',ramdisk_id='',reservation_id='r-0s5yddcg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1596712159',owner_user_name='tempest-ServersNegativeTestJSON-1596712159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:28:57Z,user_data=None,user_id='b904db715308497cbd24bfd51a34d0f9',uuid=5d03bda0-20b8-497a-a87b-faee21624468,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "address": "fa:16:3e:57:d0:dd", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af67efa-d1", "ovs_interfaceid": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Converting VIF {"id": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "address": "fa:16:3e:57:d0:dd", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af67efa-d1", "ovs_interfaceid": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d0:dd,bridge_name='br-int',has_traffic_filtering=True,id=7af67efa-d198-4abd-bbdf-a73cf48b7c43,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af67efa-d1') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG os_vif [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d0:dd,bridge_name='br-int',has_traffic_filtering=True,id=7af67efa-d198-4abd-bbdf-a73cf48b7c43,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af67efa-d1') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab4e83bd-2abd-5003-a3e1-603b074705a6', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Successfully created port: 9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG nova.compute.manager [req-071edcc6-ab60-4cde-a93a-91f4820116cb req-b27d6601-96f9-4b40-a76e-dddf88b999bf service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Received event network-changed-7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG nova.compute.manager [req-071edcc6-ab60-4cde-a93a-91f4820116cb req-b27d6601-96f9-4b40-a76e-dddf88b999bf service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Refreshing instance network info cache due to event network-changed-7af67efa-d198-4abd-bbdf-a73cf48b7c43. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-071edcc6-ab60-4cde-a93a-91f4820116cb req-b27d6601-96f9-4b40-a76e-dddf88b999bf service nova] Acquiring lock "refresh_cache-5d03bda0-20b8-497a-a87b-faee21624468" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-071edcc6-ab60-4cde-a93a-91f4820116cb req-b27d6601-96f9-4b40-a76e-dddf88b999bf service nova] Acquired lock "refresh_cache-5d03bda0-20b8-497a-a87b-faee21624468" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG nova.network.neutron [req-071edcc6-ab60-4cde-a93a-91f4820116cb req-b27d6601-96f9-4b40-a76e-dddf88b999bf service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Refreshing network info cache for port 7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG nova.network.neutron [req-853bcaf9-113b-4bc9-a0e4-245de78bd3f0 req-28ce7bd5-e5f7-42c0-af24-175189db89a7 service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Updated VIF entry in instance network info cache for port b4c13900-ad26-495d-b3e6-c791298f31fd. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG nova.network.neutron [req-853bcaf9-113b-4bc9-a0e4-245de78bd3f0 req-28ce7bd5-e5f7-42c0-af24-175189db89a7 service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Updating instance_info_cache with network_info: [{"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-853bcaf9-113b-4bc9-a0e4-245de78bd3f0 req-28ce7bd5-e5f7-42c0-af24-175189db89a7 service nova] Releasing lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG nova.network.neutron [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Successfully updated port: 116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "refresh_cache-983eadda-f7cc-410c-91b5-62082cefe9ca" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquired lock "refresh_cache-983eadda-f7cc-410c-91b5-62082cefe9ca" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:05 user nova-compute[80928]: DEBUG nova.network.neutron [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:29:05 user sudo[90500]: pam_unix(sudo:session): session closed for user root
Nov 16 05:29:05 user nova-compute[80928]: INFO oslo.privsep.daemon [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Spawned new privsep daemon via rootwrap
Nov 16 05:29:05 user nova-compute[80928]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 05:29:05 user nova-compute[80928]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 05:29:05 user nova-compute[80928]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 16 05:29:05 user nova-compute[80928]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90504
Nov 16 05:29:05 user nova-compute[80928]: WARNING oslo_privsep.priv_context [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] privsep daemon already running
Nov 16 05:29:05 user nova-compute[80928]: DEBUG nova.network.neutron [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-292e4004-615b-4167-b482-f17952e17d1a req-c6d33c6a-45bf-425a-aaf5-d60a7b743282 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Received event network-changed-116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-292e4004-615b-4167-b482-f17952e17d1a req-c6d33c6a-45bf-425a-aaf5-d60a7b743282 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Refreshing instance network info cache due to event network-changed-116f20fc-ab87-4a6a-983d-57d79b42b0a1. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-292e4004-615b-4167-b482-f17952e17d1a req-c6d33c6a-45bf-425a-aaf5-d60a7b743282 service nova] Acquiring lock "refresh_cache-983eadda-f7cc-410c-91b5-62082cefe9ca" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Successfully created port: 5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-071edcc6-ab60-4cde-a93a-91f4820116cb req-b27d6601-96f9-4b40-a76e-dddf88b999bf service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Updated VIF entry in instance network info cache for port 7af67efa-d198-4abd-bbdf-a73cf48b7c43. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-071edcc6-ab60-4cde-a93a-91f4820116cb req-b27d6601-96f9-4b40-a76e-dddf88b999bf service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Updating instance_info_cache with network_info: [{"id": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "address": "fa:16:3e:57:d0:dd", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af67efa-d1", "ovs_interfaceid": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-071edcc6-ab60-4cde-a93a-91f4820116cb req-b27d6601-96f9-4b40-a76e-dddf88b999bf service nova] Releasing lock "refresh_cache-5d03bda0-20b8-497a-a87b-faee21624468" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4c13900-ad, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4c13900-ad, col_values=(('qos', UUID('96d0c028-e58e-48b7-9028-7369410182be')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4c13900-ad, col_values=(('external_ids', {'iface-id': 'b4c13900-ad26-495d-b3e6-c791298f31fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:76:b1', 'vm-uuid': '8292134f-09d4-4240-94bb-281e6c236d09'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:06 user nova-compute[80928]: INFO os_vif [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:76:b1,bridge_name='br-int',has_traffic_filtering=True,id=b4c13900-ad26-495d-b3e6-c791298f31fd,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c13900-ad')
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7af67efa-d1, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7af67efa-d1, col_values=(('qos', UUID('20d58b59-7c0e-4070-849a-d79c9ec1c4f9')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7af67efa-d1, col_values=(('external_ids', {'iface-id': '7af67efa-d198-4abd-bbdf-a73cf48b7c43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:d0:dd', 'vm-uuid': '5d03bda0-20b8-497a-a87b-faee21624468'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:06 user nova-compute[80928]: INFO os_vif [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d0:dd,bridge_name='br-int',has_traffic_filtering=True,id=7af67efa-d198-4abd-bbdf-a73cf48b7c43,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af67efa-d1')
Nov 16 05:29:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No VIF found with MAC fa:16:3e:6c:76:b1, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] No VIF found with MAC fa:16:3e:57:d0:dd, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Successfully updated port: 9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquired lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Updating instance_info_cache with network_info: [{"id": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "address": "fa:16:3e:e7:60:ed", "network": {"id": "8d554e46-58f4-4d65-9428-8463c6cf2645", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-119277987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "416ba3a5f17c4673bf6ea5bad9be09b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116f20fc-ab", "ovs_interfaceid": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Releasing lock "refresh_cache-983eadda-f7cc-410c-91b5-62082cefe9ca" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Instance network_info: |[{"id": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "address": "fa:16:3e:e7:60:ed", "network": {"id": "8d554e46-58f4-4d65-9428-8463c6cf2645", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-119277987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "416ba3a5f17c4673bf6ea5bad9be09b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116f20fc-ab", "ovs_interfaceid": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-292e4004-615b-4167-b482-f17952e17d1a req-c6d33c6a-45bf-425a-aaf5-d60a7b743282 service nova] Acquired lock "refresh_cache-983eadda-f7cc-410c-91b5-62082cefe9ca" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.network.neutron [req-292e4004-615b-4167-b482-f17952e17d1a req-c6d33c6a-45bf-425a-aaf5-d60a7b743282 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Refreshing network info cache for port 116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Start _get_guest_xml network_info=[{"id": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "address": "fa:16:3e:e7:60:ed", "network": {"id": "8d554e46-58f4-4d65-9428-8463c6cf2645", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-119277987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "416ba3a5f17c4673bf6ea5bad9be09b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116f20fc-ab", "ovs_interfaceid": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:29:07 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:07 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-85401202-903a-454f-a2ce-d6efd86c5bb3 req-87bb7ea3-741c-4916-a668-25493e186441 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Received event network-changed-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-85401202-903a-454f-a2ce-d6efd86c5bb3 req-87bb7ea3-741c-4916-a668-25493e186441 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Refreshing instance network info cache due to event network-changed-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-85401202-903a-454f-a2ce-d6efd86c5bb3 req-87bb7ea3-741c-4916-a668-25493e186441 service nova] Acquiring lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:28:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1377853669',display_name='tempest-DeleteServersTestJSON-server-1377853669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1377853669',id=3,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='416ba3a5f17c4673bf6ea5bad9be09b0',ramdisk_id='',reservation_id='r-szn1pfau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1669441791',owner_user_name='tempest-DeleteServersTestJSON-1669441791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:00Z,user_data=None,user_id='6a72a860e8214b51bb1111442dee406d',uuid=983eadda-f7cc-410c-91b5-62082cefe9ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "address": "fa:16:3e:e7:60:ed", "network": {"id": "8d554e46-58f4-4d65-9428-8463c6cf2645", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-119277987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "416ba3a5f17c4673bf6ea5bad9be09b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116f20fc-ab", "ovs_interfaceid": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Converting VIF {"id": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "address": "fa:16:3e:e7:60:ed", "network": {"id": "8d554e46-58f4-4d65-9428-8463c6cf2645", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-119277987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "416ba3a5f17c4673bf6ea5bad9be09b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116f20fc-ab", "ovs_interfaceid": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=116f20fc-ab87-4a6a-983d-57d79b42b0a1,network=Network(8d554e46-58f4-4d65-9428-8463c6cf2645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116f20fc-ab') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.objects.instance [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lazy-loading 'pci_devices' on Instance uuid 983eadda-f7cc-410c-91b5-62082cefe9ca {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:29:07 user nova-compute[80928]:   <uuid>983eadda-f7cc-410c-91b5-62082cefe9ca</uuid>
Nov 16 05:29:07 user nova-compute[80928]:   <name>instance-00000003</name>
Nov 16 05:29:07 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:29:07 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:29:07 user nova-compute[80928]:   <metadata>
Nov 16 05:29:07 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:29:07 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:29:07 user nova-compute[80928]:       <nova:name>tempest-DeleteServersTestJSON-server-1377853669</nova:name>
Nov 16 05:29:07 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:29:07</nova:creationTime>
Nov 16 05:29:07 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:29:07 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:29:07 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:29:07 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:29:07 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:29:07 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:29:07 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:29:07 user nova-compute[80928]:       <nova:owner>
Nov 16 05:29:07 user nova-compute[80928]:         <nova:user uuid="6a72a860e8214b51bb1111442dee406d">tempest-DeleteServersTestJSON-1669441791-project-member</nova:user>
Nov 16 05:29:07 user nova-compute[80928]:         <nova:project uuid="416ba3a5f17c4673bf6ea5bad9be09b0">tempest-DeleteServersTestJSON-1669441791</nova:project>
Nov 16 05:29:07 user nova-compute[80928]:       </nova:owner>
Nov 16 05:29:07 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:29:07 user nova-compute[80928]:       <nova:ports>
Nov 16 05:29:07 user nova-compute[80928]:         <nova:port uuid="116f20fc-ab87-4a6a-983d-57d79b42b0a1">
Nov 16 05:29:07 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 05:29:07 user nova-compute[80928]:         </nova:port>
Nov 16 05:29:07 user nova-compute[80928]:       </nova:ports>
Nov 16 05:29:07 user nova-compute[80928]:     </nova:instance>
Nov 16 05:29:07 user nova-compute[80928]:   </metadata>
Nov 16 05:29:07 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:29:07 user nova-compute[80928]:     <system>
Nov 16 05:29:07 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:29:07 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:29:07 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:29:07 user nova-compute[80928]:       <entry name="serial">983eadda-f7cc-410c-91b5-62082cefe9ca</entry>
Nov 16 05:29:07 user nova-compute[80928]:       <entry name="uuid">983eadda-f7cc-410c-91b5-62082cefe9ca</entry>
Nov 16 05:29:07 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:29:07 user nova-compute[80928]:     </system>
Nov 16 05:29:07 user nova-compute[80928]:   </sysinfo>
Nov 16 05:29:07 user nova-compute[80928]:   <os>
Nov 16 05:29:07 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:29:07 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:29:07 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:29:07 user nova-compute[80928]:   </os>
Nov 16 05:29:07 user nova-compute[80928]:   <features>
Nov 16 05:29:07 user nova-compute[80928]:     <acpi/>
Nov 16 05:29:07 user nova-compute[80928]:     <apic/>
Nov 16 05:29:07 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:29:07 user nova-compute[80928]:   </features>
Nov 16 05:29:07 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:29:07 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:29:07 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:29:07 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:29:07 user nova-compute[80928]:   </clock>
Nov 16 05:29:07 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:29:07 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:29:07 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:29:07 user nova-compute[80928]:   </cpu>
Nov 16 05:29:07 user nova-compute[80928]:   <devices>
Nov 16 05:29:07 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:29:07 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:29:07 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk"/>
Nov 16 05:29:07 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:29:07 user nova-compute[80928]:     </disk>
Nov 16 05:29:07 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:29:07 user nova-compute[80928]:       <mac address="fa:16:3e:e7:60:ed"/>
Nov 16 05:29:07 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:07 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:29:07 user nova-compute[80928]:       <target dev="tap116f20fc-ab"/>
Nov 16 05:29:07 user nova-compute[80928]:     </interface>
Nov 16 05:29:07 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:29:07 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/console.log" append="off"/>
Nov 16 05:29:07 user nova-compute[80928]:     </serial>
Nov 16 05:29:07 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:29:07 user nova-compute[80928]:     <video>
Nov 16 05:29:07 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:07 user nova-compute[80928]:     </video>
Nov 16 05:29:07 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:29:07 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:29:07 user nova-compute[80928]:     </rng>
Nov 16 05:29:07 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:29:07 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:29:07 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:29:07 user nova-compute[80928]:     </memballoon>
Nov 16 05:29:07 user nova-compute[80928]:   </devices>
Nov 16 05:29:07 user nova-compute[80928]: </domain>
Nov 16 05:29:07 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:28:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1377853669',display_name='tempest-DeleteServersTestJSON-server-1377853669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1377853669',id=3,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='416ba3a5f17c4673bf6ea5bad9be09b0',ramdisk_id='',reservation_id='r-szn1pfau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1669441791',owner_user_name='tempest-DeleteServersTestJSON-1669441791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:00Z,user_data=None,user_id='6a72a860e8214b51bb1111442dee406d',uuid=983eadda-f7cc-410c-91b5-62082cefe9ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "address": "fa:16:3e:e7:60:ed", "network": {"id": "8d554e46-58f4-4d65-9428-8463c6cf2645", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-119277987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "416ba3a5f17c4673bf6ea5bad9be09b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116f20fc-ab", "ovs_interfaceid": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Converting VIF {"id": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "address": "fa:16:3e:e7:60:ed", "network": {"id": "8d554e46-58f4-4d65-9428-8463c6cf2645", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-119277987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "416ba3a5f17c4673bf6ea5bad9be09b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116f20fc-ab", "ovs_interfaceid": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=116f20fc-ab87-4a6a-983d-57d79b42b0a1,network=Network(8d554e46-58f4-4d65-9428-8463c6cf2645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116f20fc-ab') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG os_vif [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=116f20fc-ab87-4a6a-983d-57d79b42b0a1,network=Network(8d554e46-58f4-4d65-9428-8463c6cf2645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116f20fc-ab') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9400d77d-e123-589f-92e1-13fb82a3247f', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap116f20fc-ab, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap116f20fc-ab, col_values=(('qos', UUID('471966d3-fcca-4a62-9e37-f0c904cb7064')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap116f20fc-ab, col_values=(('external_ids', {'iface-id': '116f20fc-ab87-4a6a-983d-57d79b42b0a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:60:ed', 'vm-uuid': '983eadda-f7cc-410c-91b5-62082cefe9ca'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:07 user nova-compute[80928]: INFO os_vif [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=116f20fc-ab87-4a6a-983d-57d79b42b0a1,network=Network(8d554e46-58f4-4d65-9428-8463c6cf2645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116f20fc-ab')
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] No VIF found with MAC fa:16:3e:e7:60:ed, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updating instance_info_cache with network_info: [{"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Releasing lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Instance network_info: |[{"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-85401202-903a-454f-a2ce-d6efd86c5bb3 req-87bb7ea3-741c-4916-a668-25493e186441 service nova] Acquired lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.network.neutron [req-85401202-903a-454f-a2ce-d6efd86c5bb3 req-87bb7ea3-741c-4916-a668-25493e186441 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Refreshing network info cache for port 9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Start _get_guest_xml network_info=[{"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:29:07 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:07 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1416852177',display_name='tempest-ServerActionsTestOtherA-server-1416852177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1416852177',id=4,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIRZfEcvuwNYhj/y1xM6mcxohhx0m8ZHaUgJiSsxMQwSOGLIDwHJFsK0QD5y79ZqmyvT9tlBnMJypgzLM6OAyjdPrnmqxNSLqGp1Mi6dH0+QoZTXMm8gRWHjmecV7kNjw==',key_name='tempest-keypair-1523932878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-4h235xb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=762caa99-5c4a-428d-8059-7903d0bdb149,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d7:ea,bridge_name='br-int',has_traffic_filtering=True,id=9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1c448b-9e') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:07 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lazy-loading 'pci_devices' on Instance uuid 762caa99-5c4a-428d-8059-7903d0bdb149 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:29:08 user nova-compute[80928]:   <uuid>762caa99-5c4a-428d-8059-7903d0bdb149</uuid>
Nov 16 05:29:08 user nova-compute[80928]:   <name>instance-00000004</name>
Nov 16 05:29:08 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:29:08 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:29:08 user nova-compute[80928]:   <metadata>
Nov 16 05:29:08 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:29:08 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:29:08 user nova-compute[80928]:       <nova:name>tempest-ServerActionsTestOtherA-server-1416852177</nova:name>
Nov 16 05:29:08 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:29:07</nova:creationTime>
Nov 16 05:29:08 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:29:08 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:29:08 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:29:08 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:29:08 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:29:08 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:29:08 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:29:08 user nova-compute[80928]:       <nova:owner>
Nov 16 05:29:08 user nova-compute[80928]:         <nova:user uuid="6b1697de2fd04b27bc89ec6430a8a51d">tempest-ServerActionsTestOtherA-1550926993-project-member</nova:user>
Nov 16 05:29:08 user nova-compute[80928]:         <nova:project uuid="9684eff8dae04ceeb858555284d27e39">tempest-ServerActionsTestOtherA-1550926993</nova:project>
Nov 16 05:29:08 user nova-compute[80928]:       </nova:owner>
Nov 16 05:29:08 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:29:08 user nova-compute[80928]:       <nova:ports>
Nov 16 05:29:08 user nova-compute[80928]:         <nova:port uuid="9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd">
Nov 16 05:29:08 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 05:29:08 user nova-compute[80928]:         </nova:port>
Nov 16 05:29:08 user nova-compute[80928]:       </nova:ports>
Nov 16 05:29:08 user nova-compute[80928]:     </nova:instance>
Nov 16 05:29:08 user nova-compute[80928]:   </metadata>
Nov 16 05:29:08 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:29:08 user nova-compute[80928]:     <system>
Nov 16 05:29:08 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:29:08 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:29:08 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:29:08 user nova-compute[80928]:       <entry name="serial">762caa99-5c4a-428d-8059-7903d0bdb149</entry>
Nov 16 05:29:08 user nova-compute[80928]:       <entry name="uuid">762caa99-5c4a-428d-8059-7903d0bdb149</entry>
Nov 16 05:29:08 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:29:08 user nova-compute[80928]:     </system>
Nov 16 05:29:08 user nova-compute[80928]:   </sysinfo>
Nov 16 05:29:08 user nova-compute[80928]:   <os>
Nov 16 05:29:08 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:29:08 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:29:08 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:29:08 user nova-compute[80928]:   </os>
Nov 16 05:29:08 user nova-compute[80928]:   <features>
Nov 16 05:29:08 user nova-compute[80928]:     <acpi/>
Nov 16 05:29:08 user nova-compute[80928]:     <apic/>
Nov 16 05:29:08 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:29:08 user nova-compute[80928]:   </features>
Nov 16 05:29:08 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:29:08 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:29:08 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:29:08 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:29:08 user nova-compute[80928]:   </clock>
Nov 16 05:29:08 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:29:08 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:29:08 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:29:08 user nova-compute[80928]:   </cpu>
Nov 16 05:29:08 user nova-compute[80928]:   <devices>
Nov 16 05:29:08 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:29:08 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:29:08 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk"/>
Nov 16 05:29:08 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:29:08 user nova-compute[80928]:     </disk>
Nov 16 05:29:08 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:29:08 user nova-compute[80928]:       <mac address="fa:16:3e:a7:d7:ea"/>
Nov 16 05:29:08 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:08 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:29:08 user nova-compute[80928]:       <target dev="tap9a1c448b-9e"/>
Nov 16 05:29:08 user nova-compute[80928]:     </interface>
Nov 16 05:29:08 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:29:08 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/console.log" append="off"/>
Nov 16 05:29:08 user nova-compute[80928]:     </serial>
Nov 16 05:29:08 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:29:08 user nova-compute[80928]:     <video>
Nov 16 05:29:08 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:08 user nova-compute[80928]:     </video>
Nov 16 05:29:08 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:29:08 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:29:08 user nova-compute[80928]:     </rng>
Nov 16 05:29:08 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:29:08 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:29:08 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:29:08 user nova-compute[80928]:     </memballoon>
Nov 16 05:29:08 user nova-compute[80928]:   </devices>
Nov 16 05:29:08 user nova-compute[80928]: </domain>
Nov 16 05:29:08 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1416852177',display_name='tempest-ServerActionsTestOtherA-server-1416852177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1416852177',id=4,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIRZfEcvuwNYhj/y1xM6mcxohhx0m8ZHaUgJiSsxMQwSOGLIDwHJFsK0QD5y79ZqmyvT9tlBnMJypgzLM6OAyjdPrnmqxNSLqGp1Mi6dH0+QoZTXMm8gRWHjmecV7kNjw==',key_name='tempest-keypair-1523932878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-4h235xb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=762caa99-5c4a-428d-8059-7903d0bdb149,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d7:ea,bridge_name='br-int',has_traffic_filtering=True,id=9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1c448b-9e') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG os_vif [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d7:ea,bridge_name='br-int',has_traffic_filtering=True,id=9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1c448b-9e') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '666929b6-fc60-529f-ac80-145b4917551a', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a1c448b-9e, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a1c448b-9e, col_values=(('qos', UUID('ab8b3caf-ee2b-4e14-9186-baea05e009fc')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a1c448b-9e, col_values=(('external_ids', {'iface-id': '9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:d7:ea', 'vm-uuid': '762caa99-5c4a-428d-8059-7903d0bdb149'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:08 user nova-compute[80928]: INFO os_vif [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d7:ea,bridge_name='br-int',has_traffic_filtering=True,id=9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1c448b-9e')
Nov 16 05:29:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No VIF found with MAC fa:16:3e:a7:d7:ea, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG nova.network.neutron [req-292e4004-615b-4167-b482-f17952e17d1a req-c6d33c6a-45bf-425a-aaf5-d60a7b743282 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Updated VIF entry in instance network info cache for port 116f20fc-ab87-4a6a-983d-57d79b42b0a1. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG nova.network.neutron [req-292e4004-615b-4167-b482-f17952e17d1a req-c6d33c6a-45bf-425a-aaf5-d60a7b743282 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Updating instance_info_cache with network_info: [{"id": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "address": "fa:16:3e:e7:60:ed", "network": {"id": "8d554e46-58f4-4d65-9428-8463c6cf2645", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-119277987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "416ba3a5f17c4673bf6ea5bad9be09b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116f20fc-ab", "ovs_interfaceid": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-292e4004-615b-4167-b482-f17952e17d1a req-c6d33c6a-45bf-425a-aaf5-d60a7b743282 service nova] Releasing lock "refresh_cache-983eadda-f7cc-410c-91b5-62082cefe9ca" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG nova.network.neutron [req-85401202-903a-454f-a2ce-d6efd86c5bb3 req-87bb7ea3-741c-4916-a668-25493e186441 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updated VIF entry in instance network info cache for port 9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG nova.network.neutron [req-85401202-903a-454f-a2ce-d6efd86c5bb3 req-87bb7ea3-741c-4916-a668-25493e186441 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updating instance_info_cache with network_info: [{"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-85401202-903a-454f-a2ce-d6efd86c5bb3 req-87bb7ea3-741c-4916-a668-25493e186441 service nova] Releasing lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Successfully updated port: 5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "refresh_cache-5687e588-1245-42a9-b2d8-306c3c6bf8c5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquired lock "refresh_cache-5687e588-1245-42a9-b2d8-306c3c6bf8c5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-50204698-8be3-487d-98e8-55211f7bbff9 req-c86a6cbe-7b7d-4b87-8871-08f1d78ce482 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Received event network-changed-5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-50204698-8be3-487d-98e8-55211f7bbff9 req-c86a6cbe-7b7d-4b87-8871-08f1d78ce482 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Refreshing instance network info cache due to event network-changed-5ce19f2d-3fba-45ff-beb2-91952d77e21a. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-50204698-8be3-487d-98e8-55211f7bbff9 req-c86a6cbe-7b7d-4b87-8871-08f1d78ce482 service nova] Acquiring lock "refresh_cache-5687e588-1245-42a9-b2d8-306c3c6bf8c5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Updating instance_info_cache with network_info: [{"id": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "address": "fa:16:3e:41:e0:38", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce19f2d-3f", "ovs_interfaceid": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Releasing lock "refresh_cache-5687e588-1245-42a9-b2d8-306c3c6bf8c5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Instance network_info: |[{"id": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "address": "fa:16:3e:41:e0:38", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce19f2d-3f", "ovs_interfaceid": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-50204698-8be3-487d-98e8-55211f7bbff9 req-c86a6cbe-7b7d-4b87-8871-08f1d78ce482 service nova] Acquired lock "refresh_cache-5687e588-1245-42a9-b2d8-306c3c6bf8c5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-50204698-8be3-487d-98e8-55211f7bbff9 req-c86a6cbe-7b7d-4b87-8871-08f1d78ce482 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Refreshing network info cache for port 5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:29:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Start _get_guest_xml network_info=[{"id": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "address": "fa:16:3e:41:e0:38", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce19f2d-3f", "ovs_interfaceid": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:29:10 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:10 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1367235446',display_name='tempest-AttachVolumeNegativeTest-server-1367235446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1367235446',id=5,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqqaBveXhUlZCtxx2nqQZK/tN+anMq8dLx/U4hMGKNiLqpSCCi9jrye+6cS2kiF5cwxrWEN7NvUc+sJ1gtuB4CY3VcqcSmSIQmt5VtyobILVdYZV+98mHfAunYaa4AsRQ==',key_name='tempest-keypair-1305709446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f585dcb9e6cb432a9b04526ebc30e9d8',ramdisk_id='',reservation_id='r-o9ur5wwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-155531213',owner_user_name='tempest-AttachVolumeNegativeTest-155531213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952a7ea7e63649259b0b1e0df40c97d0',uuid=5687e588-1245-42a9-b2d8-306c3c6bf8c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "address": "fa:16:3e:41:e0:38", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce19f2d-3f", "ovs_interfaceid": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converting VIF {"id": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "address": "fa:16:3e:41:e0:38", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce19f2d-3f", "ovs_interfaceid": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:e0:38,bridge_name='br-int',has_traffic_filtering=True,id=5ce19f2d-3fba-45ff-beb2-91952d77e21a,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce19f2d-3f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'pci_devices' on Instance uuid 5687e588-1245-42a9-b2d8-306c3c6bf8c5 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:29:10 user nova-compute[80928]:   <uuid>5687e588-1245-42a9-b2d8-306c3c6bf8c5</uuid>
Nov 16 05:29:10 user nova-compute[80928]:   <name>instance-00000005</name>
Nov 16 05:29:10 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:29:10 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:29:10 user nova-compute[80928]:   <metadata>
Nov 16 05:29:10 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:29:10 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:29:10 user nova-compute[80928]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1367235446</nova:name>
Nov 16 05:29:10 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:29:10</nova:creationTime>
Nov 16 05:29:10 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:29:10 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:29:10 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:29:10 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:29:10 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:29:10 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:29:10 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:29:10 user nova-compute[80928]:       <nova:owner>
Nov 16 05:29:10 user nova-compute[80928]:         <nova:user uuid="952a7ea7e63649259b0b1e0df40c97d0">tempest-AttachVolumeNegativeTest-155531213-project-member</nova:user>
Nov 16 05:29:10 user nova-compute[80928]:         <nova:project uuid="f585dcb9e6cb432a9b04526ebc30e9d8">tempest-AttachVolumeNegativeTest-155531213</nova:project>
Nov 16 05:29:10 user nova-compute[80928]:       </nova:owner>
Nov 16 05:29:10 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:29:10 user nova-compute[80928]:       <nova:ports>
Nov 16 05:29:10 user nova-compute[80928]:         <nova:port uuid="5ce19f2d-3fba-45ff-beb2-91952d77e21a">
Nov 16 05:29:10 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 05:29:10 user nova-compute[80928]:         </nova:port>
Nov 16 05:29:10 user nova-compute[80928]:       </nova:ports>
Nov 16 05:29:10 user nova-compute[80928]:     </nova:instance>
Nov 16 05:29:10 user nova-compute[80928]:   </metadata>
Nov 16 05:29:10 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:29:10 user nova-compute[80928]:     <system>
Nov 16 05:29:10 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:29:10 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:29:10 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:29:10 user nova-compute[80928]:       <entry name="serial">5687e588-1245-42a9-b2d8-306c3c6bf8c5</entry>
Nov 16 05:29:10 user nova-compute[80928]:       <entry name="uuid">5687e588-1245-42a9-b2d8-306c3c6bf8c5</entry>
Nov 16 05:29:10 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:29:10 user nova-compute[80928]:     </system>
Nov 16 05:29:10 user nova-compute[80928]:   </sysinfo>
Nov 16 05:29:10 user nova-compute[80928]:   <os>
Nov 16 05:29:10 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:29:10 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:29:10 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:29:10 user nova-compute[80928]:   </os>
Nov 16 05:29:10 user nova-compute[80928]:   <features>
Nov 16 05:29:10 user nova-compute[80928]:     <acpi/>
Nov 16 05:29:10 user nova-compute[80928]:     <apic/>
Nov 16 05:29:10 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:29:10 user nova-compute[80928]:   </features>
Nov 16 05:29:10 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:29:10 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:29:10 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:29:10 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:29:10 user nova-compute[80928]:   </clock>
Nov 16 05:29:10 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:29:10 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:29:10 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:29:10 user nova-compute[80928]:   </cpu>
Nov 16 05:29:10 user nova-compute[80928]:   <devices>
Nov 16 05:29:10 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:29:10 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:29:10 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk"/>
Nov 16 05:29:10 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:29:10 user nova-compute[80928]:     </disk>
Nov 16 05:29:10 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:29:10 user nova-compute[80928]:       <mac address="fa:16:3e:41:e0:38"/>
Nov 16 05:29:10 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:10 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:29:10 user nova-compute[80928]:       <target dev="tap5ce19f2d-3f"/>
Nov 16 05:29:10 user nova-compute[80928]:     </interface>
Nov 16 05:29:10 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:29:10 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/console.log" append="off"/>
Nov 16 05:29:10 user nova-compute[80928]:     </serial>
Nov 16 05:29:10 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:29:10 user nova-compute[80928]:     <video>
Nov 16 05:29:10 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:10 user nova-compute[80928]:     </video>
Nov 16 05:29:10 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:29:10 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:29:10 user nova-compute[80928]:     </rng>
Nov 16 05:29:10 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:29:10 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:29:10 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:29:10 user nova-compute[80928]:     </memballoon>
Nov 16 05:29:10 user nova-compute[80928]:   </devices>
Nov 16 05:29:10 user nova-compute[80928]: </domain>
Nov 16 05:29:10 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1367235446',display_name='tempest-AttachVolumeNegativeTest-server-1367235446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1367235446',id=5,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqqaBveXhUlZCtxx2nqQZK/tN+anMq8dLx/U4hMGKNiLqpSCCi9jrye+6cS2kiF5cwxrWEN7NvUc+sJ1gtuB4CY3VcqcSmSIQmt5VtyobILVdYZV+98mHfAunYaa4AsRQ==',key_name='tempest-keypair-1305709446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f585dcb9e6cb432a9b04526ebc30e9d8',ramdisk_id='',reservation_id='r-o9ur5wwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-155531213',owner_user_name='tempest-AttachVolumeNegativeTest-155531213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952a7ea7e63649259b0b1e0df40c97d0',uuid=5687e588-1245-42a9-b2d8-306c3c6bf8c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "address": "fa:16:3e:41:e0:38", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce19f2d-3f", "ovs_interfaceid": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converting VIF {"id": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "address": "fa:16:3e:41:e0:38", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce19f2d-3f", "ovs_interfaceid": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:e0:38,bridge_name='br-int',has_traffic_filtering=True,id=5ce19f2d-3fba-45ff-beb2-91952d77e21a,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce19f2d-3f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG os_vif [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e0:38,bridge_name='br-int',has_traffic_filtering=True,id=5ce19f2d-3fba-45ff-beb2-91952d77e21a,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce19f2d-3f') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faec5f4b-99e0-56d2-b6b5-6ef37a0233bc', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ce19f2d-3f, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ce19f2d-3f, col_values=(('qos', UUID('a38620bb-39bb-48e6-b471-8c25d344f6cb')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ce19f2d-3f, col_values=(('external_ids', {'iface-id': '5ce19f2d-3fba-45ff-beb2-91952d77e21a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:e0:38', 'vm-uuid': '5687e588-1245-42a9-b2d8-306c3c6bf8c5'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:10 user nova-compute[80928]: INFO os_vif [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e0:38,bridge_name='br-int',has_traffic_filtering=True,id=5ce19f2d-3fba-45ff-beb2-91952d77e21a,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce19f2d-3f')
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No VIF found with MAC fa:16:3e:41:e0:38, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.network.neutron [req-50204698-8be3-487d-98e8-55211f7bbff9 req-c86a6cbe-7b7d-4b87-8871-08f1d78ce482 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Updated VIF entry in instance network info cache for port 5ce19f2d-3fba-45ff-beb2-91952d77e21a. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG nova.network.neutron [req-50204698-8be3-487d-98e8-55211f7bbff9 req-c86a6cbe-7b7d-4b87-8871-08f1d78ce482 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Updating instance_info_cache with network_info: [{"id": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "address": "fa:16:3e:41:e0:38", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce19f2d-3f", "ovs_interfaceid": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-50204698-8be3-487d-98e8-55211f7bbff9 req-c86a6cbe-7b7d-4b87-8871-08f1d78ce482 service nova] Releasing lock "refresh_cache-5687e588-1245-42a9-b2d8-306c3c6bf8c5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:14 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:29:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:29:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Instance spawned successfully.
Nov 16 05:29:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:29:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:15 user nova-compute[80928]: INFO nova.compute.manager [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Took 14.74 seconds to spawn the instance on the hypervisor.
Nov 16 05:29:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:29:15 user nova-compute[80928]: INFO nova.compute.manager [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Took 15.89 seconds to build instance.
Nov 16 05:29:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d0387c8-4d62-49ae-a8cf-0c7d868f923f tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.066s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:29:17 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Instance spawned successfully.
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:29:17 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Instance spawned successfully.
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:29:17 user nova-compute[80928]: INFO nova.compute.manager [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Took 19.86 seconds to spawn the instance on the hypervisor.
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:29:17 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Instance spawned successfully.
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:29:17 user nova-compute[80928]: INFO nova.compute.manager [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Took 20.99 seconds to spawn the instance on the hypervisor.
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:29:17 user nova-compute[80928]: INFO nova.compute.manager [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Took 21.17 seconds to build instance.
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba394bd4-537a-4fd7-87ba-cef945b85558 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "5d03bda0-20b8-497a-a87b-faee21624468" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.348s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:29:17 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Instance spawned successfully.
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:17 user nova-compute[80928]: INFO nova.compute.manager [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Took 22.58 seconds to build instance.
Nov 16 05:29:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2807097-d5ed-4f71-a753-bdc661361539 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "8292134f-09d4-4240-94bb-281e6c236d09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.944s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:17 user nova-compute[80928]: INFO nova.compute.manager [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Took 15.02 seconds to spawn the instance on the hypervisor.
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:29:17 user nova-compute[80928]: INFO nova.compute.manager [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Took 14.62 seconds to spawn the instance on the hypervisor.
Nov 16 05:29:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:29:17 user nova-compute[80928]: INFO nova.compute.manager [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Took 15.84 seconds to build instance.
Nov 16 05:29:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab22b9d6-f3b0-492c-9989-224675b7e0ee tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "762caa99-5c4a-428d-8059-7903d0bdb149" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.102s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:17 user nova-compute[80928]: INFO nova.compute.manager [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Took 15.82 seconds to build instance.
Nov 16 05:29:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7575b0d5-e9c3-406a-8219-b61cbcf1f252 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.088s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:29:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:29:18 user nova-compute[80928]: INFO nova.compute.claims [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Claim successful on node user
Nov 16 05:29:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:29:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:19 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:29:19 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:29:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.847s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:29:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.407s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:19 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:29:19 user nova-compute[80928]: INFO nova.compute.claims [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Claim successful on node user
Nov 16 05:29:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:29:19 user nova-compute[80928]: DEBUG nova.network.neutron [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:29:19 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:29:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:29:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG nova.policy [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c3163e6f11b436f980f9ffc443d4d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd2b878ead545479dc4546aab5a076e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:29:20 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Creating image(s)
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "/opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "/opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.267s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.191s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk 1073741824" returned: 0 in 0.132s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:29:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:29:20 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 16 05:29:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.398s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG nova.policy [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dd322343b204a89bdc69244a46d8203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29c8035128c48e9baa453b52c601246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:29:21 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Creating image(s)
Nov 16 05:29:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "/opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "/opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "/opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "9d7910dea7bdd8ce24c0f63070c24918cd7e7b40" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "9d7910dea7bdd8ce24c0f63070c24918cd7e7b40" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG nova.network.neutron [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Successfully created port: f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Cannot resize image /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Ensure instance console log exists: /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40.part --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40.part --force-share --output=json" returned: 0 in 0.356s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG nova.virt.images [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] 8dc86dcc-c46e-4344-8a8b-cb2120d563ed was qcow2, converting to raw {{(pid=80928) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40.part /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40.converted {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG nova.network.neutron [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Successfully updated port: f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "refresh_cache-ff21d416-8ff1-49b5-9f2b-e55df3444e8f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquired lock "refresh_cache-ff21d416-8ff1-49b5-9f2b-e55df3444e8f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG nova.network.neutron [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-8cfcf497-f1fd-41ac-92b5-cb894d7ebbad req-21048cd6-7fa5-4d80-9b44-05a43ba8fb4c service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Received event network-changed-f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-8cfcf497-f1fd-41ac-92b5-cb894d7ebbad req-21048cd6-7fa5-4d80-9b44-05a43ba8fb4c service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Refreshing instance network info cache due to event network-changed-f4e24095-a59c-4e7a-8339-8afb6230dde5. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:29:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8cfcf497-f1fd-41ac-92b5-cb894d7ebbad req-21048cd6-7fa5-4d80-9b44-05a43ba8fb4c service nova] Acquiring lock "refresh_cache-ff21d416-8ff1-49b5-9f2b-e55df3444e8f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40.part /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40.converted" returned: 0 in 0.606s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40.converted --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.network.neutron [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40.converted --force-share --output=json" returned: 0 in 0.291s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "9d7910dea7bdd8ce24c0f63070c24918cd7e7b40" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.902s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.network.neutron [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Updating instance_info_cache with network_info: [{"id": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "address": "fa:16:3e:c0:a9:eb", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e24095-a5", "ovs_interfaceid": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40 --force-share --output=json" returned: 0 in 0.291s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "9d7910dea7bdd8ce24c0f63070c24918cd7e7b40" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "9d7910dea7bdd8ce24c0f63070c24918cd7e7b40" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Releasing lock "refresh_cache-ff21d416-8ff1-49b5-9f2b-e55df3444e8f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Instance network_info: |[{"id": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "address": "fa:16:3e:c0:a9:eb", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e24095-a5", "ovs_interfaceid": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8cfcf497-f1fd-41ac-92b5-cb894d7ebbad req-21048cd6-7fa5-4d80-9b44-05a43ba8fb4c service nova] Acquired lock "refresh_cache-ff21d416-8ff1-49b5-9f2b-e55df3444e8f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-8cfcf497-f1fd-41ac-92b5-cb894d7ebbad req-21048cd6-7fa5-4d80-9b44-05a43ba8fb4c service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Refreshing network info cache for port f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Start _get_guest_xml network_info=[{"id": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "address": "fa:16:3e:c0:a9:eb", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e24095-a5", "ovs_interfaceid": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:29:23 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:23 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1106884896',display_name='tempest-VolumesAdminNegativeTest-server-1106884896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1106884896',id=6,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDErivDzfauF+a+hNvUNRpOBwCmvC7RxxqfuLyLQYFKMdLuSWG+n91VIWQ8yA+n+6cllrjjRmz8iAEwR8bI8o7EuIrn9NK1PTjkR9iBq+F7uENiwPssXh77uKOp99U34NQ==',key_name='tempest-keypair-1086129873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cd2b878ead545479dc4546aab5a076e',ramdisk_id='',reservation_id='r-5t6mgt2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1417091548',owner_user_name='tempest-VolumesAdminNegativeTest-1417091548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3163e6f11b436f980f9ffc443d4d20',uuid=ff21d416-8ff1-49b5-9f2b-e55df3444e8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "address": "fa:16:3e:c0:a9:eb", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e24095-a5", "ovs_interfaceid": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Converting VIF {"id": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "address": "fa:16:3e:c0:a9:eb", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e24095-a5", "ovs_interfaceid": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=f4e24095-a59c-4e7a-8339-8afb6230dde5,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e24095-a5') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.objects.instance [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lazy-loading 'pci_devices' on Instance uuid ff21d416-8ff1-49b5-9f2b-e55df3444e8f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:29:23 user nova-compute[80928]:   <uuid>ff21d416-8ff1-49b5-9f2b-e55df3444e8f</uuid>
Nov 16 05:29:23 user nova-compute[80928]:   <name>instance-00000006</name>
Nov 16 05:29:23 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:29:23 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:29:23 user nova-compute[80928]:   <metadata>
Nov 16 05:29:23 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:29:23 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:29:23 user nova-compute[80928]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1106884896</nova:name>
Nov 16 05:29:23 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:29:23</nova:creationTime>
Nov 16 05:29:23 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:29:23 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:29:23 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:29:23 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:29:23 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:29:23 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:29:23 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:29:23 user nova-compute[80928]:       <nova:owner>
Nov 16 05:29:23 user nova-compute[80928]:         <nova:user uuid="4c3163e6f11b436f980f9ffc443d4d20">tempest-VolumesAdminNegativeTest-1417091548-project-member</nova:user>
Nov 16 05:29:23 user nova-compute[80928]:         <nova:project uuid="0cd2b878ead545479dc4546aab5a076e">tempest-VolumesAdminNegativeTest-1417091548</nova:project>
Nov 16 05:29:23 user nova-compute[80928]:       </nova:owner>
Nov 16 05:29:23 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:29:23 user nova-compute[80928]:       <nova:ports>
Nov 16 05:29:23 user nova-compute[80928]:         <nova:port uuid="f4e24095-a59c-4e7a-8339-8afb6230dde5">
Nov 16 05:29:23 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 05:29:23 user nova-compute[80928]:         </nova:port>
Nov 16 05:29:23 user nova-compute[80928]:       </nova:ports>
Nov 16 05:29:23 user nova-compute[80928]:     </nova:instance>
Nov 16 05:29:23 user nova-compute[80928]:   </metadata>
Nov 16 05:29:23 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:29:23 user nova-compute[80928]:     <system>
Nov 16 05:29:23 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:29:23 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:29:23 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:29:23 user nova-compute[80928]:       <entry name="serial">ff21d416-8ff1-49b5-9f2b-e55df3444e8f</entry>
Nov 16 05:29:23 user nova-compute[80928]:       <entry name="uuid">ff21d416-8ff1-49b5-9f2b-e55df3444e8f</entry>
Nov 16 05:29:23 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:29:23 user nova-compute[80928]:     </system>
Nov 16 05:29:23 user nova-compute[80928]:   </sysinfo>
Nov 16 05:29:23 user nova-compute[80928]:   <os>
Nov 16 05:29:23 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:29:23 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:29:23 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:29:23 user nova-compute[80928]:   </os>
Nov 16 05:29:23 user nova-compute[80928]:   <features>
Nov 16 05:29:23 user nova-compute[80928]:     <acpi/>
Nov 16 05:29:23 user nova-compute[80928]:     <apic/>
Nov 16 05:29:23 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:29:23 user nova-compute[80928]:   </features>
Nov 16 05:29:23 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:29:23 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:29:23 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:29:23 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:29:23 user nova-compute[80928]:   </clock>
Nov 16 05:29:23 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:29:23 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:29:23 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:29:23 user nova-compute[80928]:   </cpu>
Nov 16 05:29:23 user nova-compute[80928]:   <devices>
Nov 16 05:29:23 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:29:23 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:29:23 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk"/>
Nov 16 05:29:23 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:29:23 user nova-compute[80928]:     </disk>
Nov 16 05:29:23 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:29:23 user nova-compute[80928]:       <mac address="fa:16:3e:c0:a9:eb"/>
Nov 16 05:29:23 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:23 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:29:23 user nova-compute[80928]:       <target dev="tapf4e24095-a5"/>
Nov 16 05:29:23 user nova-compute[80928]:     </interface>
Nov 16 05:29:23 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:29:23 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/console.log" append="off"/>
Nov 16 05:29:23 user nova-compute[80928]:     </serial>
Nov 16 05:29:23 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:29:23 user nova-compute[80928]:     <video>
Nov 16 05:29:23 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:23 user nova-compute[80928]:     </video>
Nov 16 05:29:23 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:29:23 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:29:23 user nova-compute[80928]:     </rng>
Nov 16 05:29:23 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:29:23 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:29:23 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:29:23 user nova-compute[80928]:     </memballoon>
Nov 16 05:29:23 user nova-compute[80928]:   </devices>
Nov 16 05:29:23 user nova-compute[80928]: </domain>
Nov 16 05:29:23 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1106884896',display_name='tempest-VolumesAdminNegativeTest-server-1106884896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1106884896',id=6,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDErivDzfauF+a+hNvUNRpOBwCmvC7RxxqfuLyLQYFKMdLuSWG+n91VIWQ8yA+n+6cllrjjRmz8iAEwR8bI8o7EuIrn9NK1PTjkR9iBq+F7uENiwPssXh77uKOp99U34NQ==',key_name='tempest-keypair-1086129873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cd2b878ead545479dc4546aab5a076e',ramdisk_id='',reservation_id='r-5t6mgt2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1417091548',owner_user_name='tempest-VolumesAdminNegativeTest-1417091548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3163e6f11b436f980f9ffc443d4d20',uuid=ff21d416-8ff1-49b5-9f2b-e55df3444e8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "address": "fa:16:3e:c0:a9:eb", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e24095-a5", "ovs_interfaceid": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Converting VIF {"id": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "address": "fa:16:3e:c0:a9:eb", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e24095-a5", "ovs_interfaceid": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=f4e24095-a59c-4e7a-8339-8afb6230dde5,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e24095-a5') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG os_vif [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=f4e24095-a59c-4e7a-8339-8afb6230dde5,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e24095-a5') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40 --force-share --output=json" returned: 0 in 0.274s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7448ba57-e28e-5cec-8bb7-eca20296f4ac', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40,backing_fmt=raw /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4e24095-a5, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4e24095-a5, col_values=(('qos', UUID('44befb53-7840-45e6-88f9-894006f9839e')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4e24095-a5, col_values=(('external_ids', {'iface-id': 'f4e24095-a59c-4e7a-8339-8afb6230dde5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:a9:eb', 'vm-uuid': 'ff21d416-8ff1-49b5-9f2b-e55df3444e8f'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40,backing_fmt=raw /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk 1073741824" returned: 0 in 0.104s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "9d7910dea7bdd8ce24c0f63070c24918cd7e7b40" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.384s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:24 user nova-compute[80928]: INFO os_vif [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=f4e24095-a59c-4e7a-8339-8afb6230dde5,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e24095-a5')
Nov 16 05:29:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] No VIF found with MAC fa:16:3e:c0:a9:eb, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-f2b21919-82fd-425d-a277-1c826c12bcd8 req-22522b3a-29f5-40f2-98a4-5ea67c493d64 service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Received event network-vif-plugged-7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f2b21919-82fd-425d-a277-1c826c12bcd8 req-22522b3a-29f5-40f2-98a4-5ea67c493d64 service nova] Acquiring lock "5d03bda0-20b8-497a-a87b-faee21624468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f2b21919-82fd-425d-a277-1c826c12bcd8 req-22522b3a-29f5-40f2-98a4-5ea67c493d64 service nova] Lock "5d03bda0-20b8-497a-a87b-faee21624468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f2b21919-82fd-425d-a277-1c826c12bcd8 req-22522b3a-29f5-40f2-98a4-5ea67c493d64 service nova] Lock "5d03bda0-20b8-497a-a87b-faee21624468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-f2b21919-82fd-425d-a277-1c826c12bcd8 req-22522b3a-29f5-40f2-98a4-5ea67c493d64 service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] No waiting events found dispatching network-vif-plugged-7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:24 user nova-compute[80928]: WARNING nova.compute.manager [req-f2b21919-82fd-425d-a277-1c826c12bcd8 req-22522b3a-29f5-40f2-98a4-5ea67c493d64 service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Received unexpected event network-vif-plugged-7af67efa-d198-4abd-bbdf-a73cf48b7c43 for instance with vm_state active and task_state None.
Nov 16 05:29:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40 --force-share --output=json" returned: 0 in 0.291s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG nova.network.neutron [req-8cfcf497-f1fd-41ac-92b5-cb894d7ebbad req-21048cd6-7fa5-4d80-9b44-05a43ba8fb4c service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Updated VIF entry in instance network info cache for port f4e24095-a59c-4e7a-8339-8afb6230dde5. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG nova.network.neutron [req-8cfcf497-f1fd-41ac-92b5-cb894d7ebbad req-21048cd6-7fa5-4d80-9b44-05a43ba8fb4c service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Updating instance_info_cache with network_info: [{"id": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "address": "fa:16:3e:c0:a9:eb", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e24095-a5", "ovs_interfaceid": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8cfcf497-f1fd-41ac-92b5-cb894d7ebbad req-21048cd6-7fa5-4d80-9b44-05a43ba8fb4c service nova] Releasing lock "refresh_cache-ff21d416-8ff1-49b5-9f2b-e55df3444e8f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk --force-share --output=json" returned: 0 in 0.378s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Cannot resize image /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Ensure instance console log exists: /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Successfully created port: 7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:29:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-91de00b2-64fe-4d1e-9af5-619fb75f1ba2 req-bc11b6c2-1645-4c15-bfbe-f6939672ce14 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Received event network-vif-plugged-5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-91de00b2-64fe-4d1e-9af5-619fb75f1ba2 req-bc11b6c2-1645-4c15-bfbe-f6939672ce14 service nova] Acquiring lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-91de00b2-64fe-4d1e-9af5-619fb75f1ba2 req-bc11b6c2-1645-4c15-bfbe-f6939672ce14 service nova] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-91de00b2-64fe-4d1e-9af5-619fb75f1ba2 req-bc11b6c2-1645-4c15-bfbe-f6939672ce14 service nova] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-91de00b2-64fe-4d1e-9af5-619fb75f1ba2 req-bc11b6c2-1645-4c15-bfbe-f6939672ce14 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] No waiting events found dispatching network-vif-plugged-5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:25 user nova-compute[80928]: WARNING nova.compute.manager [req-91de00b2-64fe-4d1e-9af5-619fb75f1ba2 req-bc11b6c2-1645-4c15-bfbe-f6939672ce14 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Received unexpected event network-vif-plugged-5ce19f2d-3fba-45ff-beb2-91952d77e21a for instance with vm_state active and task_state None.
Nov 16 05:29:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:29:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:29:25 user nova-compute[80928]: INFO nova.compute.claims [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Claim successful on node user
Nov 16 05:29:25 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:29:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:29:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-a137f54c-45b4-4aac-a0a3-4c00511fc751 req-978cf875-35f4-4671-a7a5-3d6ba1075d82 service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Received event network-vif-plugged-7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a137f54c-45b4-4aac-a0a3-4c00511fc751 req-978cf875-35f4-4671-a7a5-3d6ba1075d82 service nova] Acquiring lock "5d03bda0-20b8-497a-a87b-faee21624468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a137f54c-45b4-4aac-a0a3-4c00511fc751 req-978cf875-35f4-4671-a7a5-3d6ba1075d82 service nova] Lock "5d03bda0-20b8-497a-a87b-faee21624468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a137f54c-45b4-4aac-a0a3-4c00511fc751 req-978cf875-35f4-4671-a7a5-3d6ba1075d82 service nova] Lock "5d03bda0-20b8-497a-a87b-faee21624468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-a137f54c-45b4-4aac-a0a3-4c00511fc751 req-978cf875-35f4-4671-a7a5-3d6ba1075d82 service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] No waiting events found dispatching network-vif-plugged-7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:26 user nova-compute[80928]: WARNING nova.compute.manager [req-a137f54c-45b4-4aac-a0a3-4c00511fc751 req-978cf875-35f4-4671-a7a5-3d6ba1075d82 service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Received unexpected event network-vif-plugged-7af67efa-d198-4abd-bbdf-a73cf48b7c43 for instance with vm_state active and task_state None.
Nov 16 05:29:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-a137f54c-45b4-4aac-a0a3-4c00511fc751 req-978cf875-35f4-4671-a7a5-3d6ba1075d82 service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Received event network-vif-plugged-b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a137f54c-45b4-4aac-a0a3-4c00511fc751 req-978cf875-35f4-4671-a7a5-3d6ba1075d82 service nova] Acquiring lock "8292134f-09d4-4240-94bb-281e6c236d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a137f54c-45b4-4aac-a0a3-4c00511fc751 req-978cf875-35f4-4671-a7a5-3d6ba1075d82 service nova] Lock "8292134f-09d4-4240-94bb-281e6c236d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a137f54c-45b4-4aac-a0a3-4c00511fc751 req-978cf875-35f4-4671-a7a5-3d6ba1075d82 service nova] Lock "8292134f-09d4-4240-94bb-281e6c236d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-a137f54c-45b4-4aac-a0a3-4c00511fc751 req-978cf875-35f4-4671-a7a5-3d6ba1075d82 service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] No waiting events found dispatching network-vif-plugged-b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:26 user nova-compute[80928]: WARNING nova.compute.manager [req-a137f54c-45b4-4aac-a0a3-4c00511fc751 req-978cf875-35f4-4671-a7a5-3d6ba1075d82 service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Received unexpected event network-vif-plugged-b4c13900-ad26-495d-b3e6-c791298f31fd for instance with vm_state active and task_state None.
Nov 16 05:29:26 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG nova.policy [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6757f9f906274bd990773e36def86a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeae1a4a6d44f44a30ace81f6b2177d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:29:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Creating image(s)
Nov 16 05:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "/opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "/opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.304s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.010s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-e5af445d-f36b-4697-8fbe-c9cb99a6cd7d req-1a766ee2-9b47-4f54-8fd9-fc1a359a8acb service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Received event network-vif-plugged-5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e5af445d-f36b-4697-8fbe-c9cb99a6cd7d req-1a766ee2-9b47-4f54-8fd9-fc1a359a8acb service nova] Acquiring lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e5af445d-f36b-4697-8fbe-c9cb99a6cd7d req-1a766ee2-9b47-4f54-8fd9-fc1a359a8acb service nova] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e5af445d-f36b-4697-8fbe-c9cb99a6cd7d req-1a766ee2-9b47-4f54-8fd9-fc1a359a8acb service nova] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-e5af445d-f36b-4697-8fbe-c9cb99a6cd7d req-1a766ee2-9b47-4f54-8fd9-fc1a359a8acb service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] No waiting events found dispatching network-vif-plugged-5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:27 user nova-compute[80928]: WARNING nova.compute.manager [req-e5af445d-f36b-4697-8fbe-c9cb99a6cd7d req-1a766ee2-9b47-4f54-8fd9-fc1a359a8acb service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Received unexpected event network-vif-plugged-5ce19f2d-3fba-45ff-beb2-91952d77e21a for instance with vm_state active and task_state None.
Nov 16 05:29:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG nova.network.neutron [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Successfully updated port: 7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.354s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "refresh_cache-556f0ce2-2601-4bbe-9b0d-d70061cdc955" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquired lock "refresh_cache-556f0ce2-2601-4bbe-9b0d-d70061cdc955" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG nova.network.neutron [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk 1073741824" returned: 0 in 0.111s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.474s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Successfully created port: cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG nova.network.neutron [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.294s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Cannot resize image /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Ensure instance console log exists: /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Received event network-vif-plugged-b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] Acquiring lock "8292134f-09d4-4240-94bb-281e6c236d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] Lock "8292134f-09d4-4240-94bb-281e6c236d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.012s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] Lock "8292134f-09d4-4240-94bb-281e6c236d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] No waiting events found dispatching network-vif-plugged-b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:28 user nova-compute[80928]: WARNING nova.compute.manager [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Received unexpected event network-vif-plugged-b4c13900-ad26-495d-b3e6-c791298f31fd for instance with vm_state active and task_state None.
Nov 16 05:29:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Received event network-changed-7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Refreshing instance network info cache due to event network-changed-7d457e99-6d46-412d-95d2-6feddbd6fc9e. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] Acquiring lock "refresh_cache-556f0ce2-2601-4bbe-9b0d-d70061cdc955" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Successfully updated port: cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "refresh_cache-e8a6c1a3-ddb9-4a38-86a5-420afe793380" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquired lock "refresh_cache-e8a6c1a3-ddb9-4a38-86a5-420afe793380" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Updating instance_info_cache with network_info: [{"id": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "address": "fa:16:3e:c3:ae:ba", "network": {"id": "bd23aab1-aedf-4fc6-963c-3dd404bcdb8d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-237317009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c8035128c48e9baa453b52c601246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d457e99-6d", "ovs_interfaceid": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Releasing lock "refresh_cache-556f0ce2-2601-4bbe-9b0d-d70061cdc955" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Instance network_info: |[{"id": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "address": "fa:16:3e:c3:ae:ba", "network": {"id": "bd23aab1-aedf-4fc6-963c-3dd404bcdb8d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-237317009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c8035128c48e9baa453b52c601246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d457e99-6d", "ovs_interfaceid": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] Acquired lock "refresh_cache-556f0ce2-2601-4bbe-9b0d-d70061cdc955" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Refreshing network info cache for port 7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Start _get_guest_xml network_info=[{"id": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "address": "fa:16:3e:c3:ae:ba", "network": {"id": "bd23aab1-aedf-4fc6-963c-3dd404bcdb8d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-237317009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c8035128c48e9baa453b52c601246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d457e99-6d", "ovs_interfaceid": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:29:11Z,direct_url=<?>,disk_format='qcow2',id=8dc86dcc-c46e-4344-8a8b-cb2120d563ed,min_disk=0,min_ram=0,name='',owner='1dabbc9067664a96a224d929c5ddf358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:29:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'guest_format': None, 'device_name': '/dev/sda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '8dc86dcc-c46e-4344-8a8b-cb2120d563ed'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:29:29 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:29 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:29:11Z,direct_url=<?>,disk_format='qcow2',id=8dc86dcc-c46e-4344-8a8b-cb2120d563ed,min_disk=0,min_ram=0,name='',owner='1dabbc9067664a96a224d929c5ddf358',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:29:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1983798862',display_name='tempest-AttachSCSIVolumeTestJSON-server-1983798862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1983798862',id=7,image_ref='8dc86dcc-c46e-4344-8a8b-cb2120d563ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgO6t03wTCz41b+4SUD164w3jQ4U2+ojtTLUqCtyjMW9VTU0xVepv7bd91zxwXr9nMsngHLArPRXm+6cUhsNcMqPmtHL+9jFMaPe3UG3w45z38O7sGf1TDjYAUJm7SPsA==',key_name='tempest-keypair-443414974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b29c8035128c48e9baa453b52c601246',ramdisk_id='',reservation_id='r-wwat2row',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8dc86dcc-c46e-4344-8a8b-cb2120d563ed',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1165101549',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1165101549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dd322343b204a89bdc69244a46d8203',uuid=556f0ce2-2601-4bbe-9b0d-d70061cdc955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "address": "fa:16:3e:c3:ae:ba", "network": {"id": "bd23aab1-aedf-4fc6-963c-3dd404bcdb8d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-237317009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c8035128c48e9baa453b52c601246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d457e99-6d", "ovs_interfaceid": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Converting VIF {"id": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "address": "fa:16:3e:c3:ae:ba", "network": {"id": "bd23aab1-aedf-4fc6-963c-3dd404bcdb8d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-237317009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c8035128c48e9baa453b52c601246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d457e99-6d", "ovs_interfaceid": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ae:ba,bridge_name='br-int',has_traffic_filtering=True,id=7d457e99-6d46-412d-95d2-6feddbd6fc9e,network=Network(bd23aab1-aedf-4fc6-963c-3dd404bcdb8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d457e99-6d') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.objects.instance [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lazy-loading 'pci_devices' on Instance uuid 556f0ce2-2601-4bbe-9b0d-d70061cdc955 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:29:29 user nova-compute[80928]:   <uuid>556f0ce2-2601-4bbe-9b0d-d70061cdc955</uuid>
Nov 16 05:29:29 user nova-compute[80928]:   <name>instance-00000007</name>
Nov 16 05:29:29 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:29:29 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:29:29 user nova-compute[80928]:   <metadata>
Nov 16 05:29:29 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:29:29 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:29:29 user nova-compute[80928]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1983798862</nova:name>
Nov 16 05:29:29 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:29:29</nova:creationTime>
Nov 16 05:29:29 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:29:29 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:29:29 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:29:29 user nova-compute[80928]:       <nova:owner>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:user uuid="2dd322343b204a89bdc69244a46d8203">tempest-AttachSCSIVolumeTestJSON-1165101549-project-member</nova:user>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:project uuid="b29c8035128c48e9baa453b52c601246">tempest-AttachSCSIVolumeTestJSON-1165101549</nova:project>
Nov 16 05:29:29 user nova-compute[80928]:       </nova:owner>
Nov 16 05:29:29 user nova-compute[80928]:       <nova:root type="image" uuid="8dc86dcc-c46e-4344-8a8b-cb2120d563ed"/>
Nov 16 05:29:29 user nova-compute[80928]:       <nova:ports>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:port uuid="7d457e99-6d46-412d-95d2-6feddbd6fc9e">
Nov 16 05:29:29 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 05:29:29 user nova-compute[80928]:         </nova:port>
Nov 16 05:29:29 user nova-compute[80928]:       </nova:ports>
Nov 16 05:29:29 user nova-compute[80928]:     </nova:instance>
Nov 16 05:29:29 user nova-compute[80928]:   </metadata>
Nov 16 05:29:29 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:29:29 user nova-compute[80928]:     <system>
Nov 16 05:29:29 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:29:29 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:29:29 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:29:29 user nova-compute[80928]:       <entry name="serial">556f0ce2-2601-4bbe-9b0d-d70061cdc955</entry>
Nov 16 05:29:29 user nova-compute[80928]:       <entry name="uuid">556f0ce2-2601-4bbe-9b0d-d70061cdc955</entry>
Nov 16 05:29:29 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:29:29 user nova-compute[80928]:     </system>
Nov 16 05:29:29 user nova-compute[80928]:   </sysinfo>
Nov 16 05:29:29 user nova-compute[80928]:   <os>
Nov 16 05:29:29 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:29:29 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:29:29 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:29:29 user nova-compute[80928]:   </os>
Nov 16 05:29:29 user nova-compute[80928]:   <features>
Nov 16 05:29:29 user nova-compute[80928]:     <acpi/>
Nov 16 05:29:29 user nova-compute[80928]:     <apic/>
Nov 16 05:29:29 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:29:29 user nova-compute[80928]:   </features>
Nov 16 05:29:29 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:29:29 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:29:29 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:29:29 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:29:29 user nova-compute[80928]:   </clock>
Nov 16 05:29:29 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:29:29 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:29:29 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:29:29 user nova-compute[80928]:   </cpu>
Nov 16 05:29:29 user nova-compute[80928]:   <devices>
Nov 16 05:29:29 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:29:29 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:29:29 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk"/>
Nov 16 05:29:29 user nova-compute[80928]:       <target dev="sda" bus="scsi"/>
Nov 16 05:29:29 user nova-compute[80928]:       <address type="drive" controller="0" unit="0"/>
Nov 16 05:29:29 user nova-compute[80928]:     </disk>
Nov 16 05:29:29 user nova-compute[80928]:     <disk type="file" device="cdrom">
Nov 16 05:29:29 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 05:29:29 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk.config"/>
Nov 16 05:29:29 user nova-compute[80928]:       <target dev="sdb" bus="scsi"/>
Nov 16 05:29:29 user nova-compute[80928]:       <address type="drive" controller="0" unit="1"/>
Nov 16 05:29:29 user nova-compute[80928]:     </disk>
Nov 16 05:29:29 user nova-compute[80928]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 16 05:29:29 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:29:29 user nova-compute[80928]:       <mac address="fa:16:3e:c3:ae:ba"/>
Nov 16 05:29:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:29 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:29:29 user nova-compute[80928]:       <target dev="tap7d457e99-6d"/>
Nov 16 05:29:29 user nova-compute[80928]:     </interface>
Nov 16 05:29:29 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:29:29 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/console.log" append="off"/>
Nov 16 05:29:29 user nova-compute[80928]:     </serial>
Nov 16 05:29:29 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:29:29 user nova-compute[80928]:     <video>
Nov 16 05:29:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:29 user nova-compute[80928]:     </video>
Nov 16 05:29:29 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:29:29 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:29:29 user nova-compute[80928]:     </rng>
Nov 16 05:29:29 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:29:29 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:29:29 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:29:29 user nova-compute[80928]:     </memballoon>
Nov 16 05:29:29 user nova-compute[80928]:   </devices>
Nov 16 05:29:29 user nova-compute[80928]: </domain>
Nov 16 05:29:29 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1983798862',display_name='tempest-AttachSCSIVolumeTestJSON-server-1983798862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1983798862',id=7,image_ref='8dc86dcc-c46e-4344-8a8b-cb2120d563ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgO6t03wTCz41b+4SUD164w3jQ4U2+ojtTLUqCtyjMW9VTU0xVepv7bd91zxwXr9nMsngHLArPRXm+6cUhsNcMqPmtHL+9jFMaPe3UG3w45z38O7sGf1TDjYAUJm7SPsA==',key_name='tempest-keypair-443414974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b29c8035128c48e9baa453b52c601246',ramdisk_id='',reservation_id='r-wwat2row',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8dc86dcc-c46e-4344-8a8b-cb2120d563ed',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1165101549',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1165101549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dd322343b204a89bdc69244a46d8203',uuid=556f0ce2-2601-4bbe-9b0d-d70061cdc955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "address": "fa:16:3e:c3:ae:ba", "network": {"id": "bd23aab1-aedf-4fc6-963c-3dd404bcdb8d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-237317009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c8035128c48e9baa453b52c601246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d457e99-6d", "ovs_interfaceid": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Converting VIF {"id": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "address": "fa:16:3e:c3:ae:ba", "network": {"id": "bd23aab1-aedf-4fc6-963c-3dd404bcdb8d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-237317009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c8035128c48e9baa453b52c601246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d457e99-6d", "ovs_interfaceid": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ae:ba,bridge_name='br-int',has_traffic_filtering=True,id=7d457e99-6d46-412d-95d2-6feddbd6fc9e,network=Network(bd23aab1-aedf-4fc6-963c-3dd404bcdb8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d457e99-6d') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG os_vif [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ae:ba,bridge_name='br-int',has_traffic_filtering=True,id=7d457e99-6d46-412d-95d2-6feddbd6fc9e,network=Network(bd23aab1-aedf-4fc6-963c-3dd404bcdb8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d457e99-6d') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f0b878f-c00c-50a1-962c-48f2b7ae9ca5', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d457e99-6d, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d457e99-6d, col_values=(('qos', UUID('0da21fde-6ba5-41cd-a0fe-57d95fdc59da')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d457e99-6d, col_values=(('external_ids', {'iface-id': '7d457e99-6d46-412d-95d2-6feddbd6fc9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:ae:ba', 'vm-uuid': '556f0ce2-2601-4bbe-9b0d-d70061cdc955'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:29 user nova-compute[80928]: INFO os_vif [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ae:ba,bridge_name='br-int',has_traffic_filtering=True,id=7d457e99-6d46-412d-95d2-6feddbd6fc9e,network=Network(bd23aab1-aedf-4fc6-963c-3dd404bcdb8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d457e99-6d')
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Updating instance_info_cache with network_info: [{"id": "cf2f55ef-66cf-4992-97ee-404155885646", "address": "fa:16:3e:e1:0a:71", "network": {"id": "ddaebf50-a3a9-46ab-858a-95a4ecd44b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202869077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6eeae1a4a6d44f44a30ace81f6b2177d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2f55ef-66", "ovs_interfaceid": "cf2f55ef-66cf-4992-97ee-404155885646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Releasing lock "refresh_cache-e8a6c1a3-ddb9-4a38-86a5-420afe793380" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Instance network_info: |[{"id": "cf2f55ef-66cf-4992-97ee-404155885646", "address": "fa:16:3e:e1:0a:71", "network": {"id": "ddaebf50-a3a9-46ab-858a-95a4ecd44b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202869077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6eeae1a4a6d44f44a30ace81f6b2177d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2f55ef-66", "ovs_interfaceid": "cf2f55ef-66cf-4992-97ee-404155885646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Start _get_guest_xml network_info=[{"id": "cf2f55ef-66cf-4992-97ee-404155885646", "address": "fa:16:3e:e1:0a:71", "network": {"id": "ddaebf50-a3a9-46ab-858a-95a4ecd44b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202869077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6eeae1a4a6d44f44a30ace81f6b2177d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2f55ef-66", "ovs_interfaceid": "cf2f55ef-66cf-4992-97ee-404155885646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] No BDM found with device name sda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] No BDM found with device name sdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] No VIF found with MAC fa:16:3e:c3:ae:ba, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:29:29 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Using config drive
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-237b1c8d-7f2b-4659-9b4f-8f156ed913ab req-894763d4-7577-4abe-8d9f-b1c243d1f79f service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Received event network-changed-cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-237b1c8d-7f2b-4659-9b4f-8f156ed913ab req-894763d4-7577-4abe-8d9f-b1c243d1f79f service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Refreshing instance network info cache due to event network-changed-cf2f55ef-66cf-4992-97ee-404155885646. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-237b1c8d-7f2b-4659-9b4f-8f156ed913ab req-894763d4-7577-4abe-8d9f-b1c243d1f79f service nova] Acquiring lock "refresh_cache-e8a6c1a3-ddb9-4a38-86a5-420afe793380" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-237b1c8d-7f2b-4659-9b4f-8f156ed913ab req-894763d4-7577-4abe-8d9f-b1c243d1f79f service nova] Acquired lock "refresh_cache-e8a6c1a3-ddb9-4a38-86a5-420afe793380" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-237b1c8d-7f2b-4659-9b4f-8f156ed913ab req-894763d4-7577-4abe-8d9f-b1c243d1f79f service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Refreshing network info cache for port cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:29:29 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:29 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1935327738',display_name='tempest-TestVolumeSwap-server-1935327738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1935327738',id=8,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ+6pV9jzEIEDv4W3FgTU1ILv9iZ1P3ju+bQwN3bIuDWHMHPyJoXyLumePyHd4WZVbHHx30wKRzYcMECY5dT+rAbrCzsrEjHptsLBquh7WUo2g14x5HU0PaRGUhFm0SPg==',key_name='tempest-keypair-1571805013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6eeae1a4a6d44f44a30ace81f6b2177d',ramdisk_id='',reservation_id='r-6ohabf29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1276851544',owner_user_name='tempest-TestVolumeSwap-1276851544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6757f9f906274bd990773e36def86a09',uuid=e8a6c1a3-ddb9-4a38-86a5-420afe793380,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf2f55ef-66cf-4992-97ee-404155885646", "address": "fa:16:3e:e1:0a:71", "network": {"id": "ddaebf50-a3a9-46ab-858a-95a4ecd44b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202869077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6eeae1a4a6d44f44a30ace81f6b2177d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2f55ef-66", "ovs_interfaceid": "cf2f55ef-66cf-4992-97ee-404155885646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Converting VIF {"id": "cf2f55ef-66cf-4992-97ee-404155885646", "address": "fa:16:3e:e1:0a:71", "network": {"id": "ddaebf50-a3a9-46ab-858a-95a4ecd44b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202869077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6eeae1a4a6d44f44a30ace81f6b2177d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2f55ef-66", "ovs_interfaceid": "cf2f55ef-66cf-4992-97ee-404155885646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0a:71,bridge_name='br-int',has_traffic_filtering=True,id=cf2f55ef-66cf-4992-97ee-404155885646,network=Network(ddaebf50-a3a9-46ab-858a-95a4ecd44b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2f55ef-66') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.objects.instance [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lazy-loading 'pci_devices' on Instance uuid e8a6c1a3-ddb9-4a38-86a5-420afe793380 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:29:29 user nova-compute[80928]:   <uuid>e8a6c1a3-ddb9-4a38-86a5-420afe793380</uuid>
Nov 16 05:29:29 user nova-compute[80928]:   <name>instance-00000008</name>
Nov 16 05:29:29 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:29:29 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:29:29 user nova-compute[80928]:   <metadata>
Nov 16 05:29:29 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:29:29 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:29:29 user nova-compute[80928]:       <nova:name>tempest-TestVolumeSwap-server-1935327738</nova:name>
Nov 16 05:29:29 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:29:29</nova:creationTime>
Nov 16 05:29:29 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:29:29 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:29:29 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:29:29 user nova-compute[80928]:       <nova:owner>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:user uuid="6757f9f906274bd990773e36def86a09">tempest-TestVolumeSwap-1276851544-project-member</nova:user>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:project uuid="6eeae1a4a6d44f44a30ace81f6b2177d">tempest-TestVolumeSwap-1276851544</nova:project>
Nov 16 05:29:29 user nova-compute[80928]:       </nova:owner>
Nov 16 05:29:29 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:29:29 user nova-compute[80928]:       <nova:ports>
Nov 16 05:29:29 user nova-compute[80928]:         <nova:port uuid="cf2f55ef-66cf-4992-97ee-404155885646">
Nov 16 05:29:29 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 05:29:29 user nova-compute[80928]:         </nova:port>
Nov 16 05:29:29 user nova-compute[80928]:       </nova:ports>
Nov 16 05:29:29 user nova-compute[80928]:     </nova:instance>
Nov 16 05:29:29 user nova-compute[80928]:   </metadata>
Nov 16 05:29:29 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:29:29 user nova-compute[80928]:     <system>
Nov 16 05:29:29 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:29:29 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:29:29 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:29:29 user nova-compute[80928]:       <entry name="serial">e8a6c1a3-ddb9-4a38-86a5-420afe793380</entry>
Nov 16 05:29:29 user nova-compute[80928]:       <entry name="uuid">e8a6c1a3-ddb9-4a38-86a5-420afe793380</entry>
Nov 16 05:29:29 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:29:29 user nova-compute[80928]:     </system>
Nov 16 05:29:29 user nova-compute[80928]:   </sysinfo>
Nov 16 05:29:29 user nova-compute[80928]:   <os>
Nov 16 05:29:29 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:29:29 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:29:29 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:29:29 user nova-compute[80928]:   </os>
Nov 16 05:29:29 user nova-compute[80928]:   <features>
Nov 16 05:29:29 user nova-compute[80928]:     <acpi/>
Nov 16 05:29:29 user nova-compute[80928]:     <apic/>
Nov 16 05:29:29 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:29:29 user nova-compute[80928]:   </features>
Nov 16 05:29:29 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:29:29 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:29:29 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:29:29 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:29:29 user nova-compute[80928]:   </clock>
Nov 16 05:29:29 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:29:29 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:29:29 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:29:29 user nova-compute[80928]:   </cpu>
Nov 16 05:29:29 user nova-compute[80928]:   <devices>
Nov 16 05:29:29 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:29:29 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:29:29 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk"/>
Nov 16 05:29:29 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:29:29 user nova-compute[80928]:     </disk>
Nov 16 05:29:29 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:29:29 user nova-compute[80928]:       <mac address="fa:16:3e:e1:0a:71"/>
Nov 16 05:29:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:29 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:29:29 user nova-compute[80928]:       <target dev="tapcf2f55ef-66"/>
Nov 16 05:29:29 user nova-compute[80928]:     </interface>
Nov 16 05:29:29 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:29:29 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/console.log" append="off"/>
Nov 16 05:29:29 user nova-compute[80928]:     </serial>
Nov 16 05:29:29 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:29:29 user nova-compute[80928]:     <video>
Nov 16 05:29:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:29 user nova-compute[80928]:     </video>
Nov 16 05:29:29 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:29:29 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:29:29 user nova-compute[80928]:     </rng>
Nov 16 05:29:29 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:29:29 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:29:29 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:29:29 user nova-compute[80928]:     </memballoon>
Nov 16 05:29:29 user nova-compute[80928]:   </devices>
Nov 16 05:29:29 user nova-compute[80928]: </domain>
Nov 16 05:29:29 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1935327738',display_name='tempest-TestVolumeSwap-server-1935327738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1935327738',id=8,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ+6pV9jzEIEDv4W3FgTU1ILv9iZ1P3ju+bQwN3bIuDWHMHPyJoXyLumePyHd4WZVbHHx30wKRzYcMECY5dT+rAbrCzsrEjHptsLBquh7WUo2g14x5HU0PaRGUhFm0SPg==',key_name='tempest-keypair-1571805013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6eeae1a4a6d44f44a30ace81f6b2177d',ramdisk_id='',reservation_id='r-6ohabf29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1276851544',owner_user_name='tempest-TestVolumeSwap-1276851544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6757f9f906274bd990773e36def86a09',uuid=e8a6c1a3-ddb9-4a38-86a5-420afe793380,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf2f55ef-66cf-4992-97ee-404155885646", "address": "fa:16:3e:e1:0a:71", "network": {"id": "ddaebf50-a3a9-46ab-858a-95a4ecd44b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202869077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6eeae1a4a6d44f44a30ace81f6b2177d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2f55ef-66", "ovs_interfaceid": "cf2f55ef-66cf-4992-97ee-404155885646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Converting VIF {"id": "cf2f55ef-66cf-4992-97ee-404155885646", "address": "fa:16:3e:e1:0a:71", "network": {"id": "ddaebf50-a3a9-46ab-858a-95a4ecd44b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202869077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6eeae1a4a6d44f44a30ace81f6b2177d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2f55ef-66", "ovs_interfaceid": "cf2f55ef-66cf-4992-97ee-404155885646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0a:71,bridge_name='br-int',has_traffic_filtering=True,id=cf2f55ef-66cf-4992-97ee-404155885646,network=Network(ddaebf50-a3a9-46ab-858a-95a4ecd44b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2f55ef-66') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG os_vif [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0a:71,bridge_name='br-int',has_traffic_filtering=True,id=cf2f55ef-66cf-4992-97ee-404155885646,network=Network(ddaebf50-a3a9-46ab-858a-95a4ecd44b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2f55ef-66') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91f81540-5109-5995-815e-8e930b6edf53', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf2f55ef-66, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf2f55ef-66, col_values=(('qos', UUID('54558fbd-86e6-4813-a43a-f3ce5b44ae0f')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf2f55ef-66, col_values=(('external_ids', {'iface-id': 'cf2f55ef-66cf-4992-97ee-404155885646', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:0a:71', 'vm-uuid': 'e8a6c1a3-ddb9-4a38-86a5-420afe793380'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:29 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Instance spawned successfully.
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: INFO os_vif [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0a:71,bridge_name='br-int',has_traffic_filtering=True,id=cf2f55ef-66cf-4992-97ee-404155885646,network=Network(ddaebf50-a3a9-46ab-858a-95a4ecd44b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2f55ef-66')
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Updated VIF entry in instance network info cache for port 7d457e99-6d46-412d-95d2-6feddbd6fc9e. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Updating instance_info_cache with network_info: [{"id": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "address": "fa:16:3e:c3:ae:ba", "network": {"id": "bd23aab1-aedf-4fc6-963c-3dd404bcdb8d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-237317009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c8035128c48e9baa453b52c601246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d457e99-6d", "ovs_interfaceid": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] No VIF found with MAC fa:16:3e:e1:0a:71, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a0bea4a7-05d9-43a4-b271-a8f17d1cfec2 req-7f1edc15-7bd5-4bb9-8705-96187c562259 service nova] Releasing lock "refresh_cache-556f0ce2-2601-4bbe-9b0d-d70061cdc955" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:29 user nova-compute[80928]: INFO nova.compute.manager [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Took 9.83 seconds to spawn the instance on the hypervisor.
Nov 16 05:29:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:29:30 user nova-compute[80928]: INFO nova.compute.manager [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Took 11.54 seconds to build instance.
Nov 16 05:29:30 user nova-compute[80928]: DEBUG nova.network.neutron [req-237b1c8d-7f2b-4659-9b4f-8f156ed913ab req-894763d4-7577-4abe-8d9f-b1c243d1f79f service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Updated VIF entry in instance network info cache for port cf2f55ef-66cf-4992-97ee-404155885646. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:29:30 user nova-compute[80928]: DEBUG nova.network.neutron [req-237b1c8d-7f2b-4659-9b4f-8f156ed913ab req-894763d4-7577-4abe-8d9f-b1c243d1f79f service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Updating instance_info_cache with network_info: [{"id": "cf2f55ef-66cf-4992-97ee-404155885646", "address": "fa:16:3e:e1:0a:71", "network": {"id": "ddaebf50-a3a9-46ab-858a-95a4ecd44b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202869077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6eeae1a4a6d44f44a30ace81f6b2177d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2f55ef-66", "ovs_interfaceid": "cf2f55ef-66cf-4992-97ee-404155885646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5d5ae54a-6166-460d-b71d-11674524ac4e tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.784s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-237b1c8d-7f2b-4659-9b4f-8f156ed913ab req-894763d4-7577-4abe-8d9f-b1c243d1f79f service nova] Releasing lock "refresh_cache-e8a6c1a3-ddb9-4a38-86a5-420afe793380" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:30 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Creating config drive at /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk.config
Nov 16 05:29:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0kfdycqq {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0kfdycqq" returned: 0 in 0.075s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-cbdabd13-5059-4e6c-b0f1-4dca71e2e868 req-aced72b8-82bd-45b4-a147-0c507fd85b67 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Received event network-vif-plugged-116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cbdabd13-5059-4e6c-b0f1-4dca71e2e868 req-aced72b8-82bd-45b4-a147-0c507fd85b67 service nova] Acquiring lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cbdabd13-5059-4e6c-b0f1-4dca71e2e868 req-aced72b8-82bd-45b4-a147-0c507fd85b67 service nova] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cbdabd13-5059-4e6c-b0f1-4dca71e2e868 req-aced72b8-82bd-45b4-a147-0c507fd85b67 service nova] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-cbdabd13-5059-4e6c-b0f1-4dca71e2e868 req-aced72b8-82bd-45b4-a147-0c507fd85b67 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] No waiting events found dispatching network-vif-plugged-116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:33 user nova-compute[80928]: WARNING nova.compute.manager [req-cbdabd13-5059-4e6c-b0f1-4dca71e2e868 req-aced72b8-82bd-45b4-a147-0c507fd85b67 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Received unexpected event network-vif-plugged-116f20fc-ab87-4a6a-983d-57d79b42b0a1 for instance with vm_state active and task_state None.
Nov 16 05:29:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-479120f0-2fee-4f33-a796-63e44828fe8d req-18462c6e-28d2-4b20-96a0-3ca91a23cbdb service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Received event network-vif-plugged-116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-479120f0-2fee-4f33-a796-63e44828fe8d req-18462c6e-28d2-4b20-96a0-3ca91a23cbdb service nova] Acquiring lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-479120f0-2fee-4f33-a796-63e44828fe8d req-18462c6e-28d2-4b20-96a0-3ca91a23cbdb service nova] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-479120f0-2fee-4f33-a796-63e44828fe8d req-18462c6e-28d2-4b20-96a0-3ca91a23cbdb service nova] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-479120f0-2fee-4f33-a796-63e44828fe8d req-18462c6e-28d2-4b20-96a0-3ca91a23cbdb service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] No waiting events found dispatching network-vif-plugged-116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:35 user nova-compute[80928]: WARNING nova.compute.manager [req-479120f0-2fee-4f33-a796-63e44828fe8d req-18462c6e-28d2-4b20-96a0-3ca91a23cbdb service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Received unexpected event network-vif-plugged-116f20fc-ab87-4a6a-983d-57d79b42b0a1 for instance with vm_state active and task_state None.
Nov 16 05:29:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:29:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:29:37 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Instance spawned successfully.
Nov 16 05:29:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:29:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Instance spawned successfully.
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:38 user nova-compute[80928]: INFO nova.compute.manager [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Took 11.32 seconds to spawn the instance on the hypervisor.
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:29:38 user nova-compute[80928]: INFO nova.compute.manager [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Took 16.82 seconds to spawn the instance on the hypervisor.
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:29:38 user nova-compute[80928]: INFO nova.compute.manager [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Took 12.88 seconds to build instance.
Nov 16 05:29:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b092d005-c9e3-4293-b574-9265e1b357ef tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.037s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:38 user nova-compute[80928]: INFO nova.compute.manager [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Took 19.22 seconds to build instance.
Nov 16 05:29:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa660fc2-1aef-4a19-ad04-f77ab76f97ec tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.493s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-6f8cdc0e-0cd1-4933-878f-a5d80e62466f req-c12860de-36c3-4315-89cd-bca24441d284 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Received event network-vif-plugged-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6f8cdc0e-0cd1-4933-878f-a5d80e62466f req-c12860de-36c3-4315-89cd-bca24441d284 service nova] Acquiring lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6f8cdc0e-0cd1-4933-878f-a5d80e62466f req-c12860de-36c3-4315-89cd-bca24441d284 service nova] Lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6f8cdc0e-0cd1-4933-878f-a5d80e62466f req-c12860de-36c3-4315-89cd-bca24441d284 service nova] Lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-6f8cdc0e-0cd1-4933-878f-a5d80e62466f req-c12860de-36c3-4315-89cd-bca24441d284 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] No waiting events found dispatching network-vif-plugged-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:38 user nova-compute[80928]: WARNING nova.compute.manager [req-6f8cdc0e-0cd1-4933-878f-a5d80e62466f req-c12860de-36c3-4315-89cd-bca24441d284 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Received unexpected event network-vif-plugged-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd for instance with vm_state active and task_state None.
Nov 16 05:29:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Acquiring lock "f3367d72-f511-4285-a77b-b26932bf7490" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "f3367d72-f511-4285-a77b-b26932bf7490" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:39 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:29:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:39 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:29:39 user nova-compute[80928]: INFO nova.compute.claims [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Claim successful on node user
Nov 16 05:29:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:29:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.policy [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c76780e408c44031a91287a76e85cbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc897cf00e6b450e964cf9979fd5fc15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:29:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Creating image(s)
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "/opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "/opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Received event network-vif-plugged-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] Acquiring lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] Lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] Lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] No waiting events found dispatching network-vif-plugged-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:40 user nova-compute[80928]: WARNING nova.compute.manager [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Received unexpected event network-vif-plugged-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd for instance with vm_state active and task_state None.
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Received event network-vif-plugged-cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] Acquiring lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] No waiting events found dispatching network-vif-plugged-cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:40 user nova-compute[80928]: WARNING nova.compute.manager [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Received unexpected event network-vif-plugged-cf2f55ef-66cf-4992-97ee-404155885646 for instance with vm_state active and task_state None.
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Received event network-vif-plugged-cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] Acquiring lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] No waiting events found dispatching network-vif-plugged-cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:40 user nova-compute[80928]: WARNING nova.compute.manager [req-523b0b21-16db-400c-8755-6530b51259cc req-616cbcf1-2e67-4057-8139-eafb17afdaae service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Received unexpected event network-vif-plugged-cf2f55ef-66cf-4992-97ee-404155885646 for instance with vm_state active and task_state None.
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.320s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-c930e839-896a-4ba6-8e6d-ebfda762ac48 req-e712b0ee-24fb-425d-b9e7-2b6d823d3bf1 service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Received event network-vif-plugged-f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c930e839-896a-4ba6-8e6d-ebfda762ac48 req-e712b0ee-24fb-425d-b9e7-2b6d823d3bf1 service nova] Acquiring lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c930e839-896a-4ba6-8e6d-ebfda762ac48 req-e712b0ee-24fb-425d-b9e7-2b6d823d3bf1 service nova] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c930e839-896a-4ba6-8e6d-ebfda762ac48 req-e712b0ee-24fb-425d-b9e7-2b6d823d3bf1 service nova] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-c930e839-896a-4ba6-8e6d-ebfda762ac48 req-e712b0ee-24fb-425d-b9e7-2b6d823d3bf1 service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] No waiting events found dispatching network-vif-plugged-f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:41 user nova-compute[80928]: WARNING nova.compute.manager [req-c930e839-896a-4ba6-8e6d-ebfda762ac48 req-e712b0ee-24fb-425d-b9e7-2b6d823d3bf1 service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Received unexpected event network-vif-plugged-f4e24095-a59c-4e7a-8339-8afb6230dde5 for instance with vm_state active and task_state None.
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk 1073741824" returned: 0 in 0.095s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Successfully created port: f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.238s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Cannot resize image /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Ensure instance console log exists: /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Successfully updated port: f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Acquiring lock "refresh_cache-f3367d72-f511-4285-a77b-b26932bf7490" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Acquired lock "refresh_cache-f3367d72-f511-4285-a77b-b26932bf7490" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-b0470bc9-33c6-428b-954c-b7ca4292ab8f req-cbad082a-47b6-4eae-8b00-6850e610ebb2 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Received event network-changed-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-b0470bc9-33c6-428b-954c-b7ca4292ab8f req-cbad082a-47b6-4eae-8b00-6850e610ebb2 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Refreshing instance network info cache due to event network-changed-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b0470bc9-33c6-428b-954c-b7ca4292ab8f req-cbad082a-47b6-4eae-8b00-6850e610ebb2 service nova] Acquiring lock "refresh_cache-f3367d72-f511-4285-a77b-b26932bf7490" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Updating instance_info_cache with network_info: [{"id": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "address": "fa:16:3e:4f:e8:78", "network": {"id": "0ba3296e-39e0-4dcc-8238-d1a8970ac672", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508086287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc897cf00e6b450e964cf9979fd5fc15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99a8c0e-61", "ovs_interfaceid": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Releasing lock "refresh_cache-f3367d72-f511-4285-a77b-b26932bf7490" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Instance network_info: |[{"id": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "address": "fa:16:3e:4f:e8:78", "network": {"id": "0ba3296e-39e0-4dcc-8238-d1a8970ac672", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508086287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc897cf00e6b450e964cf9979fd5fc15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99a8c0e-61", "ovs_interfaceid": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b0470bc9-33c6-428b-954c-b7ca4292ab8f req-cbad082a-47b6-4eae-8b00-6850e610ebb2 service nova] Acquired lock "refresh_cache-f3367d72-f511-4285-a77b-b26932bf7490" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.network.neutron [req-b0470bc9-33c6-428b-954c-b7ca4292ab8f req-cbad082a-47b6-4eae-8b00-6850e610ebb2 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Refreshing network info cache for port f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Start _get_guest_xml network_info=[{"id": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "address": "fa:16:3e:4f:e8:78", "network": {"id": "0ba3296e-39e0-4dcc-8238-d1a8970ac672", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508086287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc897cf00e6b450e964cf9979fd5fc15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99a8c0e-61", "ovs_interfaceid": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:29:42 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:42 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1679350400',display_name='tempest-VolumesAssistedSnapshotsTest-server-1679350400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1679350400',id=9,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoNGoaymXl5x2qmmdL3FxmuviApCX+nVXxQne4n12Yk3nOF4xfMNvHz0FXYMpSim8qXtSlKJmzdI5WMgLZAervct1yjdvwd0h+s9ahpWYIOvBvAKl1OPt/N/PTJqtoPdw==',key_name='tempest-keypair-1087333632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc897cf00e6b450e964cf9979fd5fc15',ramdisk_id='',reservation_id='r-slcplm8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1847412678',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1847412678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c76780e408c44031a91287a76e85cbcc',uuid=f3367d72-f511-4285-a77b-b26932bf7490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "address": "fa:16:3e:4f:e8:78", "network": {"id": "0ba3296e-39e0-4dcc-8238-d1a8970ac672", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508086287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc897cf00e6b450e964cf9979fd5fc15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99a8c0e-61", "ovs_interfaceid": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Converting VIF {"id": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "address": "fa:16:3e:4f:e8:78", "network": {"id": "0ba3296e-39e0-4dcc-8238-d1a8970ac672", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508086287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc897cf00e6b450e964cf9979fd5fc15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99a8c0e-61", "ovs_interfaceid": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e8:78,bridge_name='br-int',has_traffic_filtering=True,id=f99a8c0e-612a-49fa-ab8b-4435ed59c9f5,network=Network(0ba3296e-39e0-4dcc-8238-d1a8970ac672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99a8c0e-61') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.objects.instance [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lazy-loading 'pci_devices' on Instance uuid f3367d72-f511-4285-a77b-b26932bf7490 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:29:42 user nova-compute[80928]:   <uuid>f3367d72-f511-4285-a77b-b26932bf7490</uuid>
Nov 16 05:29:42 user nova-compute[80928]:   <name>instance-00000009</name>
Nov 16 05:29:42 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:29:42 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:29:42 user nova-compute[80928]:   <metadata>
Nov 16 05:29:42 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:29:42 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:29:42 user nova-compute[80928]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1679350400</nova:name>
Nov 16 05:29:42 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:29:42</nova:creationTime>
Nov 16 05:29:42 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:29:42 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:29:42 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:29:42 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:29:42 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:29:42 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:29:42 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:29:42 user nova-compute[80928]:       <nova:owner>
Nov 16 05:29:42 user nova-compute[80928]:         <nova:user uuid="c76780e408c44031a91287a76e85cbcc">tempest-VolumesAssistedSnapshotsTest-1847412678-project-member</nova:user>
Nov 16 05:29:42 user nova-compute[80928]:         <nova:project uuid="fc897cf00e6b450e964cf9979fd5fc15">tempest-VolumesAssistedSnapshotsTest-1847412678</nova:project>
Nov 16 05:29:42 user nova-compute[80928]:       </nova:owner>
Nov 16 05:29:42 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:29:42 user nova-compute[80928]:       <nova:ports>
Nov 16 05:29:42 user nova-compute[80928]:         <nova:port uuid="f99a8c0e-612a-49fa-ab8b-4435ed59c9f5">
Nov 16 05:29:42 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 05:29:42 user nova-compute[80928]:         </nova:port>
Nov 16 05:29:42 user nova-compute[80928]:       </nova:ports>
Nov 16 05:29:42 user nova-compute[80928]:     </nova:instance>
Nov 16 05:29:42 user nova-compute[80928]:   </metadata>
Nov 16 05:29:42 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:29:42 user nova-compute[80928]:     <system>
Nov 16 05:29:42 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:29:42 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:29:42 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:29:42 user nova-compute[80928]:       <entry name="serial">f3367d72-f511-4285-a77b-b26932bf7490</entry>
Nov 16 05:29:42 user nova-compute[80928]:       <entry name="uuid">f3367d72-f511-4285-a77b-b26932bf7490</entry>
Nov 16 05:29:42 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:29:42 user nova-compute[80928]:     </system>
Nov 16 05:29:42 user nova-compute[80928]:   </sysinfo>
Nov 16 05:29:42 user nova-compute[80928]:   <os>
Nov 16 05:29:42 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:29:42 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:29:42 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:29:42 user nova-compute[80928]:   </os>
Nov 16 05:29:42 user nova-compute[80928]:   <features>
Nov 16 05:29:42 user nova-compute[80928]:     <acpi/>
Nov 16 05:29:42 user nova-compute[80928]:     <apic/>
Nov 16 05:29:42 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:29:42 user nova-compute[80928]:   </features>
Nov 16 05:29:42 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:29:42 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:29:42 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:29:42 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:29:42 user nova-compute[80928]:   </clock>
Nov 16 05:29:42 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:29:42 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:29:42 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:29:42 user nova-compute[80928]:   </cpu>
Nov 16 05:29:42 user nova-compute[80928]:   <devices>
Nov 16 05:29:42 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:29:42 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:29:42 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk"/>
Nov 16 05:29:42 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:29:42 user nova-compute[80928]:     </disk>
Nov 16 05:29:42 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:29:42 user nova-compute[80928]:       <mac address="fa:16:3e:4f:e8:78"/>
Nov 16 05:29:42 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:42 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:29:42 user nova-compute[80928]:       <target dev="tapf99a8c0e-61"/>
Nov 16 05:29:42 user nova-compute[80928]:     </interface>
Nov 16 05:29:42 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:29:42 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/console.log" append="off"/>
Nov 16 05:29:42 user nova-compute[80928]:     </serial>
Nov 16 05:29:42 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:29:42 user nova-compute[80928]:     <video>
Nov 16 05:29:42 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:29:42 user nova-compute[80928]:     </video>
Nov 16 05:29:42 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:29:42 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:29:42 user nova-compute[80928]:     </rng>
Nov 16 05:29:42 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:29:42 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:29:42 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:29:42 user nova-compute[80928]:     </memballoon>
Nov 16 05:29:42 user nova-compute[80928]:   </devices>
Nov 16 05:29:42 user nova-compute[80928]: </domain>
Nov 16 05:29:42 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1679350400',display_name='tempest-VolumesAssistedSnapshotsTest-server-1679350400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1679350400',id=9,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoNGoaymXl5x2qmmdL3FxmuviApCX+nVXxQne4n12Yk3nOF4xfMNvHz0FXYMpSim8qXtSlKJmzdI5WMgLZAervct1yjdvwd0h+s9ahpWYIOvBvAKl1OPt/N/PTJqtoPdw==',key_name='tempest-keypair-1087333632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc897cf00e6b450e964cf9979fd5fc15',ramdisk_id='',reservation_id='r-slcplm8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1847412678',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1847412678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c76780e408c44031a91287a76e85cbcc',uuid=f3367d72-f511-4285-a77b-b26932bf7490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "address": "fa:16:3e:4f:e8:78", "network": {"id": "0ba3296e-39e0-4dcc-8238-d1a8970ac672", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508086287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc897cf00e6b450e964cf9979fd5fc15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99a8c0e-61", "ovs_interfaceid": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Converting VIF {"id": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "address": "fa:16:3e:4f:e8:78", "network": {"id": "0ba3296e-39e0-4dcc-8238-d1a8970ac672", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508086287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc897cf00e6b450e964cf9979fd5fc15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99a8c0e-61", "ovs_interfaceid": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e8:78,bridge_name='br-int',has_traffic_filtering=True,id=f99a8c0e-612a-49fa-ab8b-4435ed59c9f5,network=Network(0ba3296e-39e0-4dcc-8238-d1a8970ac672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99a8c0e-61') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG os_vif [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e8:78,bridge_name='br-int',has_traffic_filtering=True,id=f99a8c0e-612a-49fa-ab8b-4435ed59c9f5,network=Network(0ba3296e-39e0-4dcc-8238-d1a8970ac672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99a8c0e-61') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f164a932-fbab-5b4f-bb0b-f3996f07c56e', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf99a8c0e-61, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf99a8c0e-61, col_values=(('qos', UUID('58deb356-4c39-45e7-98a6-010a81af8942')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf99a8c0e-61, col_values=(('external_ids', {'iface-id': 'f99a8c0e-612a-49fa-ab8b-4435ed59c9f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:e8:78', 'vm-uuid': 'f3367d72-f511-4285-a77b-b26932bf7490'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:42 user nova-compute[80928]: INFO os_vif [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e8:78,bridge_name='br-int',has_traffic_filtering=True,id=f99a8c0e-612a-49fa-ab8b-4435ed59c9f5,network=Network(0ba3296e-39e0-4dcc-8238-d1a8970ac672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99a8c0e-61')
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:29:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] No VIF found with MAC fa:16:3e:4f:e8:78, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:29:43 user nova-compute[80928]: DEBUG nova.network.neutron [req-b0470bc9-33c6-428b-954c-b7ca4292ab8f req-cbad082a-47b6-4eae-8b00-6850e610ebb2 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Updated VIF entry in instance network info cache for port f99a8c0e-612a-49fa-ab8b-4435ed59c9f5. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:29:43 user nova-compute[80928]: DEBUG nova.network.neutron [req-b0470bc9-33c6-428b-954c-b7ca4292ab8f req-cbad082a-47b6-4eae-8b00-6850e610ebb2 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Updating instance_info_cache with network_info: [{"id": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "address": "fa:16:3e:4f:e8:78", "network": {"id": "0ba3296e-39e0-4dcc-8238-d1a8970ac672", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508086287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc897cf00e6b450e964cf9979fd5fc15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99a8c0e-61", "ovs_interfaceid": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b0470bc9-33c6-428b-954c-b7ca4292ab8f req-cbad082a-47b6-4eae-8b00-6850e610ebb2 service nova] Releasing lock "refresh_cache-f3367d72-f511-4285-a77b-b26932bf7490" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:43 user nova-compute[80928]: DEBUG nova.compute.manager [req-d777735b-43f6-497d-a0b5-0069a2677cdf req-88ebe891-2629-4fc2-959b-12e1bb820d63 service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Received event network-vif-plugged-f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d777735b-43f6-497d-a0b5-0069a2677cdf req-88ebe891-2629-4fc2-959b-12e1bb820d63 service nova] Acquiring lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d777735b-43f6-497d-a0b5-0069a2677cdf req-88ebe891-2629-4fc2-959b-12e1bb820d63 service nova] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d777735b-43f6-497d-a0b5-0069a2677cdf req-88ebe891-2629-4fc2-959b-12e1bb820d63 service nova] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.015s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:43 user nova-compute[80928]: DEBUG nova.compute.manager [req-d777735b-43f6-497d-a0b5-0069a2677cdf req-88ebe891-2629-4fc2-959b-12e1bb820d63 service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] No waiting events found dispatching network-vif-plugged-f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:43 user nova-compute[80928]: WARNING nova.compute.manager [req-d777735b-43f6-497d-a0b5-0069a2677cdf req-88ebe891-2629-4fc2-959b-12e1bb820d63 service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Received unexpected event network-vif-plugged-f4e24095-a59c-4e7a-8339-8afb6230dde5 for instance with vm_state active and task_state None.
Nov 16 05:29:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-6b8b363f-27f1-480e-ba80-1ae9bf6ba215 req-1275f902-5ec5-4c72-85bb-8b2f0352f1a7 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Received event network-vif-plugged-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6b8b363f-27f1-480e-ba80-1ae9bf6ba215 req-1275f902-5ec5-4c72-85bb-8b2f0352f1a7 service nova] Acquiring lock "f3367d72-f511-4285-a77b-b26932bf7490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6b8b363f-27f1-480e-ba80-1ae9bf6ba215 req-1275f902-5ec5-4c72-85bb-8b2f0352f1a7 service nova] Lock "f3367d72-f511-4285-a77b-b26932bf7490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6b8b363f-27f1-480e-ba80-1ae9bf6ba215 req-1275f902-5ec5-4c72-85bb-8b2f0352f1a7 service nova] Lock "f3367d72-f511-4285-a77b-b26932bf7490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-6b8b363f-27f1-480e-ba80-1ae9bf6ba215 req-1275f902-5ec5-4c72-85bb-8b2f0352f1a7 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] No waiting events found dispatching network-vif-plugged-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:44 user nova-compute[80928]: WARNING nova.compute.manager [req-6b8b363f-27f1-480e-ba80-1ae9bf6ba215 req-1275f902-5ec5-4c72-85bb-8b2f0352f1a7 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Received unexpected event network-vif-plugged-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 for instance with vm_state building and task_state spawning.
Nov 16 05:29:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-9b57d0d7-b8ce-4748-aa87-9f239fb08619 req-5176b793-425d-4a33-80a1-9e2f2afdcd31 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Received event network-vif-plugged-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9b57d0d7-b8ce-4748-aa87-9f239fb08619 req-5176b793-425d-4a33-80a1-9e2f2afdcd31 service nova] Acquiring lock "f3367d72-f511-4285-a77b-b26932bf7490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9b57d0d7-b8ce-4748-aa87-9f239fb08619 req-5176b793-425d-4a33-80a1-9e2f2afdcd31 service nova] Lock "f3367d72-f511-4285-a77b-b26932bf7490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9b57d0d7-b8ce-4748-aa87-9f239fb08619 req-5176b793-425d-4a33-80a1-9e2f2afdcd31 service nova] Lock "f3367d72-f511-4285-a77b-b26932bf7490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-9b57d0d7-b8ce-4748-aa87-9f239fb08619 req-5176b793-425d-4a33-80a1-9e2f2afdcd31 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] No waiting events found dispatching network-vif-plugged-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:46 user nova-compute[80928]: WARNING nova.compute.manager [req-9b57d0d7-b8ce-4748-aa87-9f239fb08619 req-5176b793-425d-4a33-80a1-9e2f2afdcd31 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Received unexpected event network-vif-plugged-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 for instance with vm_state building and task_state spawning.
Nov 16 05:29:47 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:29:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:29:47 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Instance spawned successfully.
Nov 16 05:29:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:29:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:29:47 user nova-compute[80928]: INFO nova.compute.manager [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Took 6.51 seconds to spawn the instance on the hypervisor.
Nov 16 05:29:47 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:29:47 user nova-compute[80928]: INFO nova.compute.manager [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Took 7.59 seconds to build instance.
Nov 16 05:29:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0012c230-c70e-4229-83eb-2b92fd3799f4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "f3367d72-f511-4285-a77b-b26932bf7490" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.720s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-d1a180e5-d4ec-4a18-9d81-633f2182be76 req-aba13351-dbdc-4a01-8a06-43dee151fc2d service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Received event network-vif-plugged-7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d1a180e5-d4ec-4a18-9d81-633f2182be76 req-aba13351-dbdc-4a01-8a06-43dee151fc2d service nova] Acquiring lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d1a180e5-d4ec-4a18-9d81-633f2182be76 req-aba13351-dbdc-4a01-8a06-43dee151fc2d service nova] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d1a180e5-d4ec-4a18-9d81-633f2182be76 req-aba13351-dbdc-4a01-8a06-43dee151fc2d service nova] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-d1a180e5-d4ec-4a18-9d81-633f2182be76 req-aba13351-dbdc-4a01-8a06-43dee151fc2d service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] No waiting events found dispatching network-vif-plugged-7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:48 user nova-compute[80928]: WARNING nova.compute.manager [req-d1a180e5-d4ec-4a18-9d81-633f2182be76 req-aba13351-dbdc-4a01-8a06-43dee151fc2d service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Received unexpected event network-vif-plugged-7d457e99-6d46-412d-95d2-6feddbd6fc9e for instance with vm_state active and task_state None.
Nov 16 05:29:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:29:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 05:29:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] There are 0 instances to clean {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 05:29:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:29:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances with incomplete migration  {{(pid=80928) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 05:29:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:29:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-ee4fd6c1-d976-47d9-9f59-6a0606d46684 req-e9baad91-c6ec-4b59-a726-23445120ece2 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Received event network-vif-plugged-7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:29:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ee4fd6c1-d976-47d9-9f59-6a0606d46684 req-e9baad91-c6ec-4b59-a726-23445120ece2 service nova] Acquiring lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ee4fd6c1-d976-47d9-9f59-6a0606d46684 req-e9baad91-c6ec-4b59-a726-23445120ece2 service nova] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ee4fd6c1-d976-47d9-9f59-6a0606d46684 req-e9baad91-c6ec-4b59-a726-23445120ece2 service nova] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-ee4fd6c1-d976-47d9-9f59-6a0606d46684 req-e9baad91-c6ec-4b59-a726-23445120ece2 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] No waiting events found dispatching network-vif-plugged-7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:29:50 user nova-compute[80928]: WARNING nova.compute.manager [req-ee4fd6c1-d976-47d9-9f59-6a0606d46684 req-e9baad91-c6ec-4b59-a726-23445120ece2 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Received unexpected event network-vif-plugged-7d457e99-6d46-412d-95d2-6feddbd6fc9e for instance with vm_state active and task_state None.
Nov 16 05:29:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:29:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:29:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:29:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:52 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:29:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json" returned: 0 in 0.343s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:29:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:29:57 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:57 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7339MB free_disk=25.779605865478516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5d03bda0-20b8-497a-a87b-faee21624468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 983eadda-f7cc-410c-91b5-62082cefe9ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5687e588-1245-42a9-b2d8-306c3c6bf8c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 556f0ce2-2601-4bbe-9b0d-d70061cdc955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance e8a6c1a3-ddb9-4a38-86a5-420afe793380 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance f3367d72-f511-4285-a77b-b26932bf7490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:29:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:29:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:29:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:29:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:29:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 8292134f-09d4-4240-94bb-281e6c236d09 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "1ff80388-e16c-41aa-966a-0446af885ba1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:29:59 user nova-compute[80928]: INFO nova.compute.claims [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Claim successful on node user
Nov 16 05:29:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Updating instance_info_cache with network_info: [{"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:29:59 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Refreshing inventories for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 05:30:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Updating ProviderTree inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 05:30:00 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 05:30:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Refreshing aggregate associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, aggregates: None {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 05:30:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Refreshing trait associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 05:30:00 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:30:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:30:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:30:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:30:00 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:30:00 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:30:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:30:00 user nova-compute[80928]: INFO nova.virt.block_device [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Booting with volume bbc22edd-058f-477d-9504-c2d18b1a130b at /dev/vda
Nov 16 05:30:00 user nova-compute[80928]: DEBUG nova.policy [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6070d3e906d74a9d93d50037d26021d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff30b8ac9de49d8978525934fa2b6da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:30:00 user nova-compute[80928]: DEBUG os_brick.utils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:30:00 user nova-compute[80928]: INFO oslo.privsep.daemon [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpe7_bvkd7/privsep.sock']
Nov 16 05:30:00 user sudo[92210]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpe7_bvkd7/privsep.sock
Nov 16 05:30:00 user sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 05:30:01 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Successfully created port: fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:30:01 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Successfully created port: 31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:30:02 user sudo[92210]: pam_unix(sudo:session): session closed for user root
Nov 16 05:30:02 user nova-compute[80928]: INFO oslo.privsep.daemon [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Spawned new privsep daemon via rootwrap
Nov 16 05:30:02 user nova-compute[80928]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 05:30:02 user nova-compute[80928]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 05:30:02 user nova-compute[80928]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 16 05:30:02 user nova-compute[80928]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 92262
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a625c968-ddfc-440e-9716-2dfbb77988d1]: (2,) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Successfully created port: 3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b8456d-8b13-449b-b3f1-2be61a26ed8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:02 user nova-compute[80928]: WARNING os_brick.initiator.connectors.nvmeof [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cec7fb-ce6e-4185-9bb1-3a01596ac822]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebded68-4932-41d6-97da-0dfa94b30eb8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1581490b-bdd7-48ff-b7c2-075092186a42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:30:02 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:30:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0f8f4d-d411-4799-90b6-3acf2e49e025]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG os_brick.utils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] <== get_connector_properties: return (1814ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating existing volume attachment record: 0e72ec1f-3459-4ce4-a0e3-108abbe86699 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:30:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:03 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Successfully created port: b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:30:03 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Successfully created port: 37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:30:04 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Successfully updated port: fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:30:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-e57547ec-8e9d-4e1b-8127-82f6d532b277 req-3568c57d-577e-45b2-b164-9d8c5b2e675f service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-changed-fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-e57547ec-8e9d-4e1b-8127-82f6d532b277 req-3568c57d-577e-45b2-b164-9d8c5b2e675f service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing instance network info cache due to event network-changed-fd1457c1-62ef-454f-961d-50effb0739d3. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:30:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e57547ec-8e9d-4e1b-8127-82f6d532b277 req-3568c57d-577e-45b2-b164-9d8c5b2e675f service nova] Acquiring lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e57547ec-8e9d-4e1b-8127-82f6d532b277 req-3568c57d-577e-45b2-b164-9d8c5b2e675f service nova] Acquired lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:04 user nova-compute[80928]: DEBUG nova.network.neutron [req-e57547ec-8e9d-4e1b-8127-82f6d532b277 req-3568c57d-577e-45b2-b164-9d8c5b2e675f service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing network info cache for port fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:30:04 user nova-compute[80928]: DEBUG nova.network.neutron [req-e57547ec-8e9d-4e1b-8127-82f6d532b277 req-3568c57d-577e-45b2-b164-9d8c5b2e675f service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:30:04 user nova-compute[80928]: DEBUG nova.network.neutron [req-e57547ec-8e9d-4e1b-8127-82f6d532b277 req-3568c57d-577e-45b2-b164-9d8c5b2e675f service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e57547ec-8e9d-4e1b-8127-82f6d532b277 req-3568c57d-577e-45b2-b164-9d8c5b2e675f service nova] Releasing lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:05 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Successfully updated port: 3ab11ca7-0003-41bf-8689-6089a640da67 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:30:05 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Successfully updated port: 0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-changed-3ab11ca7-0003-41bf-8689-6089a640da67 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing instance network info cache due to event network-changed-3ab11ca7-0003-41bf-8689-6089a640da67. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] Acquiring lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] Acquired lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing network info cache for port 3ab11ca7-0003-41bf-8689-6089a640da67 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Successfully updated port: 31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] Releasing lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-changed-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing instance network info cache due to event network-changed-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] Acquiring lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] Acquired lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing network info cache for port 0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-13fd922b-c3f7-46a4-a136-0ba52d038e3d req-3e0cb0d9-5d17-4593-be77-ec8ddfe97ea3 service nova] Releasing lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Successfully updated port: 3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:07 user nova-compute[80928]: INFO nova.virt.block_device [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Booting with volume e93aeec0-2b62-4285-af1f-3aae91221f05 at /dev/vdb
Nov 16 05:30:07 user nova-compute[80928]: DEBUG os_brick.utils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b545702-167a-4f6c-94ea-0f9adf917212]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ae7372-0746-45ad-801b-24f8f288a322]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Successfully updated port: b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fa4112-fbd6-4086-bb6b-b9e85fb6a443]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd82b9d9-fb9d-41f1-b7cf-a5968c4f7e06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:30:07 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:30:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[655afc14-2ff9-49b5-b21e-d2895fcffd4a]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG os_brick.utils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:30:07 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating existing volume attachment record: 21ca8281-465c-473c-a43a-c2b408e6b416 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-changed-31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing instance network info cache due to event network-changed-31fe312e-632b-438e-aca2-3be48e901146. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] Acquiring lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] Acquired lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG nova.network.neutron [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing network info cache for port 31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG nova.network.neutron [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG nova.network.neutron [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] Releasing lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-changed-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing instance network info cache due to event network-changed-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] Acquiring lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] Acquired lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:08 user nova-compute[80928]: DEBUG nova.network.neutron [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing network info cache for port 3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Successfully updated port: 37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] Releasing lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-changed-b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing instance network info cache due to event network-changed-b3aee6c6-4e9c-49b4-8555-08ff64eef094. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] Acquiring lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] Acquired lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing network info cache for port b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a6acacee-b83e-47e4-aaca-b80ca4a853e8 req-e14491b6-01db-444a-a8d5-7bd87d06dd0c service nova] Releasing lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquired lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:30:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:30:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:10 user nova-compute[80928]: DEBUG nova.compute.manager [req-feaf3a11-f430-40aa-8ace-53d907fadfbf req-3316144d-d141-4168-8831-c19e4c500eb2 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-changed-37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:10 user nova-compute[80928]: DEBUG nova.compute.manager [req-feaf3a11-f430-40aa-8ace-53d907fadfbf req-3316144d-d141-4168-8831-c19e4c500eb2 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing instance network info cache due to event network-changed-37120823-c20c-4315-ad71-ee3d35752385. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:30:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-feaf3a11-f430-40aa-8ace-53d907fadfbf req-3316144d-d141-4168-8831-c19e4c500eb2 service nova] Acquiring lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating instance_info_cache with network_info: [{"id": "fd1457c1-62ef-454f-961d-50effb0739d3", "address": "fa:16:3e:d7:88:d0", "network": {"id": "c4921244-898f-485d-83d9-27f2534bb016", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1221631381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1457c1-62", "ovs_interfaceid": "fd1457c1-62ef-454f-961d-50effb0739d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ab11ca7-0003-41bf-8689-6089a640da67", "address": "fa:16:3e:f5:4c:17", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab11ca7-00", "ovs_interfaceid": "3ab11ca7-0003-41bf-8689-6089a640da67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "address": "fa:16:3e:be:0a:cf", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef09bdc-d8", "ovs_interfaceid": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31fe312e-632b-438e-aca2-3be48e901146", "address": "fa:16:3e:79:95:2f", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fe312e-63", "ovs_interfaceid": "31fe312e-632b-438e-aca2-3be48e901146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "address": "fa:16:3e:a6:eb:47", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cabd761-23", "ovs_interfaceid": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "address": "fa:16:3e:b1:08:68", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3aee6c6-4e", "ovs_interfaceid": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37120823-c20c-4315-ad71-ee3d35752385", "address": "fa:16:3e:56:d2:9d", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37120823-c2", "ovs_interfaceid": "37120823-c20c-4315-ad71-ee3d35752385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Releasing lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:11 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Instance network_info: |[{"id": "fd1457c1-62ef-454f-961d-50effb0739d3", "address": "fa:16:3e:d7:88:d0", "network": {"id": "c4921244-898f-485d-83d9-27f2534bb016", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1221631381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1457c1-62", "ovs_interfaceid": "fd1457c1-62ef-454f-961d-50effb0739d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ab11ca7-0003-41bf-8689-6089a640da67", "address": "fa:16:3e:f5:4c:17", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab11ca7-00", "ovs_interfaceid": "3ab11ca7-0003-41bf-8689-6089a640da67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "address": "fa:16:3e:be:0a:cf", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef09bdc-d8", "ovs_interfaceid": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31fe312e-632b-438e-aca2-3be48e901146", "address": "fa:16:3e:79:95:2f", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fe312e-63", "ovs_interfaceid": "31fe312e-632b-438e-aca2-3be48e901146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "address": "fa:16:3e:a6:eb:47", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cabd761-23", "ovs_interfaceid": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "address": "fa:16:3e:b1:08:68", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3aee6c6-4e", "ovs_interfaceid": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37120823-c20c-4315-ad71-ee3d35752385", "address": "fa:16:3e:56:d2:9d", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37120823-c2", "ovs_interfaceid": "37120823-c20c-4315-ad71-ee3d35752385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:30:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-feaf3a11-f430-40aa-8ace-53d907fadfbf req-3316144d-d141-4168-8831-c19e4c500eb2 service nova] Acquired lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:11 user nova-compute[80928]: DEBUG nova.network.neutron [req-feaf3a11-f430-40aa-8ace-53d907fadfbf req-3316144d-d141-4168-8831-c19e4c500eb2 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing network info cache for port 37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:30:11 user nova-compute[80928]: DEBUG nova.network.neutron [req-feaf3a11-f430-40aa-8ace-53d907fadfbf req-3316144d-d141-4168-8831-c19e4c500eb2 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updated VIF entry in instance network info cache for port 37120823-c20c-4315-ad71-ee3d35752385. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:30:11 user nova-compute[80928]: DEBUG nova.network.neutron [req-feaf3a11-f430-40aa-8ace-53d907fadfbf req-3316144d-d141-4168-8831-c19e4c500eb2 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating instance_info_cache with network_info: [{"id": "fd1457c1-62ef-454f-961d-50effb0739d3", "address": "fa:16:3e:d7:88:d0", "network": {"id": "c4921244-898f-485d-83d9-27f2534bb016", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1221631381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1457c1-62", "ovs_interfaceid": "fd1457c1-62ef-454f-961d-50effb0739d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ab11ca7-0003-41bf-8689-6089a640da67", "address": "fa:16:3e:f5:4c:17", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab11ca7-00", "ovs_interfaceid": "3ab11ca7-0003-41bf-8689-6089a640da67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "address": "fa:16:3e:be:0a:cf", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef09bdc-d8", "ovs_interfaceid": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31fe312e-632b-438e-aca2-3be48e901146", "address": "fa:16:3e:79:95:2f", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fe312e-63", "ovs_interfaceid": "31fe312e-632b-438e-aca2-3be48e901146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "address": "fa:16:3e:a6:eb:47", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cabd761-23", "ovs_interfaceid": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "address": "fa:16:3e:b1:08:68", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3aee6c6-4e", "ovs_interfaceid": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37120823-c20c-4315-ad71-ee3d35752385", "address": "fa:16:3e:56:d2:9d", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37120823-c2", "ovs_interfaceid": "37120823-c20c-4315-ad71-ee3d35752385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-feaf3a11-f430-40aa-8ace-53d907fadfbf req-3316144d-d141-4168-8831-c19e4c500eb2 service nova] Releasing lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:13 user nova-compute[80928]: INFO nova.virt.block_device [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Booting with volume 957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 at /dev/vdc
Nov 16 05:30:13 user nova-compute[80928]: DEBUG os_brick.utils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1573aa76-7c1c-4ffe-9b81-ae9c60ac38a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3368e5-88b3-4e25-a138-9c2421f266f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[368d8f2c-2392-4e1a-b1a9-bb2df8c05e01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06cd4c0-b05c-4375-8d0a-f56448ce1158]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:30:13 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:30:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a060f43-f291-4862-96a9-6245cff6ad34]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG os_brick.utils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:30:13 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating existing volume attachment record: 5962495a-0aac-472f-ab13-b4cf024962ee {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:30:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:30:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Creating image(s)
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Ensure instance console log exists: /opt/stack/data/nova/instances/1ff80388-e16c-41aa-966a-0446af885ba1/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Start _get_guest_xml network_info=[{"id": "fd1457c1-62ef-454f-961d-50effb0739d3", "address": "fa:16:3e:d7:88:d0", "network": {"id": "c4921244-898f-485d-83d9-27f2534bb016", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1221631381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1457c1-62", "ovs_interfaceid": "fd1457c1-62ef-454f-961d-50effb0739d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ab11ca7-0003-41bf-8689-6089a640da67", "address": "fa:16:3e:f5:4c:17", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab11ca7-00", "ovs_interfaceid": "3ab11ca7-0003-41bf-8689-6089a640da67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "address": "fa:16:3e:be:0a:cf", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef09bdc-d8", "ovs_interfaceid": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31fe312e-632b-438e-aca2-3be48e901146", "address": "fa:16:3e:79:95:2f", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fe312e-63", "ovs_interfaceid": "31fe312e-632b-438e-aca2-3be48e901146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "address": "fa:16:3e:a6:eb:47", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cabd761-23", "ovs_interfaceid": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "address": "fa:16:3e:b1:08:68", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3aee6c6-4e", "ovs_interfaceid": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37120823-c20c-4315-ad71-ee3d35752385", "address": "fa:16:3e:56:d2:9d", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37120823-c2", "ovs_interfaceid": "37120823-c20c-4315-ad71-ee3d35752385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBDxizcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ff80388-e16c-41aa-966a-0446af885ba1', 'attached_at': '', 'detached_at': '', 'volume_id': 'bbc22edd-058f-477d-9504-c2d18b1a130b', 'serial': 'bbc22edd-058f-477d-9504-c2d18b1a130b'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '0e72ec1f-3459-4ce4-a0e3-108abbe86699', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgYaWDfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ff80388-e16c-41aa-966a-0446af885ba1', 'attached_at': '', 'detached_at': '', 'volume_id': 'e93aeec0-2b62-4285-af1f-3aae91221f05', 'serial': 'e93aeec0-2b62-4285-af1f-3aae91221f05'}, 'boot_index': 1, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '21ca8281-465c-473c-a43a-c2b408e6b416', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyNjrYpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ff80388-e16c-41aa-966a-0446af885ba1', 'attached_at': '', 'detached_at': '', 'volume_id': '957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2', 'serial': '957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2'}, 'boot_index': 2, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '5962495a-0aac-472f-ab13-b4cf024962ee', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:30:18 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:30:18 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connector [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Factory for ISCSI on None {{(pid=80928) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBDxizcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:30:19 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:30:19 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:30:19 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a582c0-9024-411a-a430-52899a015649]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:30:19 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2476c8b-0a0e-4c3f-9a80-9f143ba20244]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b] added
Nov 16 05:30:19 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ac97bd-9b45-423d-af5d-c5c91f1b0a95]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0cacc1-a98d-4e88-9755-8dac1732dca6]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JBDxizcs {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JBDxizcs" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99017a1-e019-4c91-80db-3ab880a649d1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JBDxizcs'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9270a15-fd4f-41de-bded-56880ca093ac]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baab4b4-1acd-49ea-8c9b-095fa2219e2b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 05:30:19 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 05:30:19 user nova-compute[80928]:  {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:30:19 user nova-compute[80928]: WARNING os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 05:30:19 user nova-compute[80928]: 
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a499724-486c-40ba-a37b-e0faf6d09849]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b, portal: 172.16.0.220,3260]
Nov 16 05:30:19 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b, portal: 172.16.0.220,3260] successful.
Nov 16 05:30:19 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab5038e-5cd6-4c8c-82c4-dd4e25b15d4b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd838292-e471-4779-b3f8-372a46b2098a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:19 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:19 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bfd323-aaf1-41de-b565-50786929da54]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:30:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBDxizcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23263343935353166', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263343935353166', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgYaWDfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:30:20 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:30:20 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:30:20 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[baee9c0b-08a4-4df1-badb-a70a8f02e71a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:30:20 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ac99aa-e5d9-42d8-b7cc-7c904efe9b1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05] added
Nov 16 05:30:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5736c24b-031f-4928-8756-480041c3083e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbc2ace-88ec-4d8d-b5bc-e3b286024e5c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HgYaWDfu {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HgYaWDfu" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bb4be5-cbf4-40a4-b291-d470620460e8]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HgYaWDfu'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af5076f-c985-4761-afaa-c0a621808cf0]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01aae12-42fa-416b-a8dc-856363476f6e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14bfa9b-5724-4ae9-b8ee-cef030dacfd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05, portal: 172.16.0.220,3260]
Nov 16 05:30:20 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05, portal: 172.16.0.220,3260] successful.
Nov 16 05:30:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.161s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[173f0a70-49b1-4b44-9be9-a6da6e710d66]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67ef08e-e836-4ce8-a654-499011fa44a5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:20 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:20 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e162c65e-f578-46af-89b6-cc46be6f5111]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:30:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgYaWDfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '23365613330613138', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365613330613138', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyNjrYpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:30:21 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:30:21 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:30:21 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[31afeb61-b808-4cd7-8487-747b6e3b754c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:30:21 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bbdba7-73f5-4b7c-bbdd-650ca34c18c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2] added
Nov 16 05:30:21 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc1a94b-d8e7-4d2e-90f9-3b2210c5c906]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52e30b5-2e99-44b2-871f-c506daf50158]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SyNjrYpm {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SyNjrYpm" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[809133ce-eb6a-4890-bd64-601337b30824]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SyNjrYpm'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5ece9a-cfac-408a-b4f9-c103075f05fe]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[087d6066-d54c-4859-be39-3efa9e985d53]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:21 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:21 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:21 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:21 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:30:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[87571aee-2708-4d10-8b0e-cc134289e3f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2, portal: 172.16.0.220,3260]
Nov 16 05:30:22 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2, portal: 172.16.0.220,3260] successful.
Nov 16 05:30:22 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee2741c-255a-4cf8-b43c-81b77d2fc376]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[42900274-4035-4ec0-90d8-c4543a2eaa85]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:22 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:22 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:30:22 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:22 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:22 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:30:22 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f515e571-d853-4dce-abf4-c096b0561768]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyNjrYpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26464303031663932', 'path': '/dev/sdd'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464303031663932', 'path': '/dev/sdd'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd1457c1-62ef-454f-961d-50effb0739d3", "address": "fa:16:3e:d7:88:d0", "network": {"id": "c4921244-898f-485d-83d9-27f2534bb016", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1221631381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1457c1-62", "ovs_interfaceid": "fd1457c1-62ef-454f-961d-50effb0739d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "fd1457c1-62ef-454f-961d-50effb0739d3", "address": "fa:16:3e:d7:88:d0", "network": {"id": "c4921244-898f-485d-83d9-27f2534bb016", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1221631381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1457c1-62", "ovs_interfaceid": "fd1457c1-62ef-454f-961d-50effb0739d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=fd1457c1-62ef-454f-961d-50effb0739d3,network=Network(c4921244-898f-485d-83d9-27f2534bb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1457c1-62') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ab11ca7-0003-41bf-8689-6089a640da67", "address": "fa:16:3e:f5:4c:17", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab11ca7-00", "ovs_interfaceid": "3ab11ca7-0003-41bf-8689-6089a640da67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "3ab11ca7-0003-41bf-8689-6089a640da67", "address": "fa:16:3e:f5:4c:17", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab11ca7-00", "ovs_interfaceid": "3ab11ca7-0003-41bf-8689-6089a640da67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:4c:17,bridge_name='br-int',has_traffic_filtering=True,id=3ab11ca7-0003-41bf-8689-6089a640da67,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ab11ca7-00') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "address": "fa:16:3e:be:0a:cf", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef09bdc-d8", "ovs_interfaceid": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "address": "fa:16:3e:be:0a:cf", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef09bdc-d8", "ovs_interfaceid": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0a:cf,bridge_name='br-int',has_traffic_filtering=True,id=0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ef09bdc-d8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31fe312e-632b-438e-aca2-3be48e901146", "address": "fa:16:3e:79:95:2f", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fe312e-63", "ovs_interfaceid": "31fe312e-632b-438e-aca2-3be48e901146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "31fe312e-632b-438e-aca2-3be48e901146", "address": "fa:16:3e:79:95:2f", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fe312e-63", "ovs_interfaceid": "31fe312e-632b-438e-aca2-3be48e901146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:95:2f,bridge_name='br-int',has_traffic_filtering=True,id=31fe312e-632b-438e-aca2-3be48e901146,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fe312e-63') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "address": "fa:16:3e:a6:eb:47", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cabd761-23", "ovs_interfaceid": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "address": "fa:16:3e:a6:eb:47", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cabd761-23", "ovs_interfaceid": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:eb:47,bridge_name='br-int',has_traffic_filtering=True,id=3cabd761-23fe-44ac-b3c7-9778cf0d9bfc,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cabd761-23') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "address": "fa:16:3e:b1:08:68", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3aee6c6-4e", "ovs_interfaceid": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "address": "fa:16:3e:b1:08:68", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3aee6c6-4e", "ovs_interfaceid": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:08:68,bridge_name='br-int',has_traffic_filtering=True,id=b3aee6c6-4e9c-49b4-8555-08ff64eef094,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3aee6c6-4e') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37120823-c20c-4315-ad71-ee3d35752385", "address": "fa:16:3e:56:d2:9d", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37120823-c2", "ovs_interfaceid": "37120823-c20c-4315-ad71-ee3d35752385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "37120823-c20c-4315-ad71-ee3d35752385", "address": "fa:16:3e:56:d2:9d", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37120823-c2", "ovs_interfaceid": "37120823-c20c-4315-ad71-ee3d35752385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=37120823-c20c-4315-ad71-ee3d35752385,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37120823-c2') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.objects.instance [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ff80388-e16c-41aa-966a-0446af885ba1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:30:23 user nova-compute[80928]:   <uuid>1ff80388-e16c-41aa-966a-0446af885ba1</uuid>
Nov 16 05:30:23 user nova-compute[80928]:   <name>instance-0000000a</name>
Nov 16 05:30:23 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:30:23 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:30:23 user nova-compute[80928]:   <metadata>
Nov 16 05:30:23 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:30:23 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:30:23 user nova-compute[80928]:       <nova:name>tempest-device-tagging-server-361033167</nova:name>
Nov 16 05:30:23 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:30:18</nova:creationTime>
Nov 16 05:30:23 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:30:23 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:30:23 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:30:23 user nova-compute[80928]:       <nova:owner>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:user uuid="6070d3e906d74a9d93d50037d26021d5">tempest-TaggedBootDevicesTest_v242-1171869254-project-member</nova:user>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:project uuid="7ff30b8ac9de49d8978525934fa2b6da">tempest-TaggedBootDevicesTest_v242-1171869254</nova:project>
Nov 16 05:30:23 user nova-compute[80928]:       </nova:owner>
Nov 16 05:30:23 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:30:23 user nova-compute[80928]:       <nova:ports>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:port uuid="fd1457c1-62ef-454f-961d-50effb0739d3">
Nov 16 05:30:23 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:30:23 user nova-compute[80928]:         </nova:port>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:port uuid="3ab11ca7-0003-41bf-8689-6089a640da67">
Nov 16 05:30:23 user nova-compute[80928]:           <nova:ip type="fixed" address="10.1.1.64" ipVersion="4"/>
Nov 16 05:30:23 user nova-compute[80928]:         </nova:port>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:port uuid="0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9">
Nov 16 05:30:23 user nova-compute[80928]:           <nova:ip type="fixed" address="10.1.1.17" ipVersion="4"/>
Nov 16 05:30:23 user nova-compute[80928]:         </nova:port>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:port uuid="31fe312e-632b-438e-aca2-3be48e901146">
Nov 16 05:30:23 user nova-compute[80928]:           <nova:ip type="fixed" address="10.1.1.108" ipVersion="4"/>
Nov 16 05:30:23 user nova-compute[80928]:         </nova:port>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:port uuid="3cabd761-23fe-44ac-b3c7-9778cf0d9bfc">
Nov 16 05:30:23 user nova-compute[80928]:           <nova:ip type="fixed" address="10.1.1.111" ipVersion="4"/>
Nov 16 05:30:23 user nova-compute[80928]:         </nova:port>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:port uuid="b3aee6c6-4e9c-49b4-8555-08ff64eef094">
Nov 16 05:30:23 user nova-compute[80928]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 05:30:23 user nova-compute[80928]:         </nova:port>
Nov 16 05:30:23 user nova-compute[80928]:         <nova:port uuid="37120823-c20c-4315-ad71-ee3d35752385">
Nov 16 05:30:23 user nova-compute[80928]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 05:30:23 user nova-compute[80928]:         </nova:port>
Nov 16 05:30:23 user nova-compute[80928]:       </nova:ports>
Nov 16 05:30:23 user nova-compute[80928]:     </nova:instance>
Nov 16 05:30:23 user nova-compute[80928]:   </metadata>
Nov 16 05:30:23 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:30:23 user nova-compute[80928]:     <system>
Nov 16 05:30:23 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:30:23 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:30:23 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:30:23 user nova-compute[80928]:       <entry name="serial">1ff80388-e16c-41aa-966a-0446af885ba1</entry>
Nov 16 05:30:23 user nova-compute[80928]:       <entry name="uuid">1ff80388-e16c-41aa-966a-0446af885ba1</entry>
Nov 16 05:30:23 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:30:23 user nova-compute[80928]:     </system>
Nov 16 05:30:23 user nova-compute[80928]:   </sysinfo>
Nov 16 05:30:23 user nova-compute[80928]:   <os>
Nov 16 05:30:23 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:30:23 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:30:23 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:30:23 user nova-compute[80928]:   </os>
Nov 16 05:30:23 user nova-compute[80928]:   <features>
Nov 16 05:30:23 user nova-compute[80928]:     <acpi/>
Nov 16 05:30:23 user nova-compute[80928]:     <apic/>
Nov 16 05:30:23 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:30:23 user nova-compute[80928]:   </features>
Nov 16 05:30:23 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:30:23 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:30:23 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:30:23 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:30:23 user nova-compute[80928]:   </clock>
Nov 16 05:30:23 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:30:23 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:30:23 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:30:23 user nova-compute[80928]:   </cpu>
Nov 16 05:30:23 user nova-compute[80928]:   <devices>
Nov 16 05:30:23 user nova-compute[80928]:     <disk type="file" device="cdrom">
Nov 16 05:30:23 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 05:30:23 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/1ff80388-e16c-41aa-966a-0446af885ba1/disk.config"/>
Nov 16 05:30:23 user nova-compute[80928]:       <target dev="hda" bus="ide"/>
Nov 16 05:30:23 user nova-compute[80928]:     </disk>
Nov 16 05:30:23 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:30:23 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:30:23 user nova-compute[80928]:       <source dev="/dev/sdb"/>
Nov 16 05:30:23 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:30:23 user nova-compute[80928]:       <serial>bbc22edd-058f-477d-9504-c2d18b1a130b</serial>
Nov 16 05:30:23 user nova-compute[80928]:     </disk>
Nov 16 05:30:23 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:30:23 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:30:23 user nova-compute[80928]:       <source dev="/dev/sdc"/>
Nov 16 05:30:23 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:30:23 user nova-compute[80928]:       <serial>e93aeec0-2b62-4285-af1f-3aae91221f05</serial>
Nov 16 05:30:23 user nova-compute[80928]:     </disk>
Nov 16 05:30:23 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:30:23 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:30:23 user nova-compute[80928]:       <source dev="/dev/sdd"/>
Nov 16 05:30:23 user nova-compute[80928]:       <target dev="vdc" bus="virtio"/>
Nov 16 05:30:23 user nova-compute[80928]:       <serial>957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2</serial>
Nov 16 05:30:23 user nova-compute[80928]:     </disk>
Nov 16 05:30:23 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:30:23 user nova-compute[80928]:       <mac address="fa:16:3e:d7:88:d0"/>
Nov 16 05:30:23 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:30:23 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:30:23 user nova-compute[80928]:       <target dev="tapfd1457c1-62"/>
Nov 16 05:30:23 user nova-compute[80928]:     </interface>
Nov 16 05:30:23 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:30:23 user nova-compute[80928]:       <mac address="fa:16:3e:f5:4c:17"/>
Nov 16 05:30:23 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:30:23 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:30:23 user nova-compute[80928]:       <target dev="tap3ab11ca7-00"/>
Nov 16 05:30:23 user nova-compute[80928]:     </interface>
Nov 16 05:30:23 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:30:23 user nova-compute[80928]:       <mac address="fa:16:3e:be:0a:cf"/>
Nov 16 05:30:23 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:30:23 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:30:23 user nova-compute[80928]:       <target dev="tap0ef09bdc-d8"/>
Nov 16 05:30:23 user nova-compute[80928]:     </interface>
Nov 16 05:30:23 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:30:23 user nova-compute[80928]:       <mac address="fa:16:3e:79:95:2f"/>
Nov 16 05:30:23 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:30:23 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:30:23 user nova-compute[80928]:       <target dev="tap31fe312e-63"/>
Nov 16 05:30:23 user nova-compute[80928]:     </interface>
Nov 16 05:30:23 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:30:23 user nova-compute[80928]:       <mac address="fa:16:3e:a6:eb:47"/>
Nov 16 05:30:23 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:30:23 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:30:23 user nova-compute[80928]:       <target dev="tap3cabd761-23"/>
Nov 16 05:30:23 user nova-compute[80928]:     </interface>
Nov 16 05:30:23 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:30:23 user nova-compute[80928]:       <mac address="fa:16:3e:b1:08:68"/>
Nov 16 05:30:23 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:30:23 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:30:23 user nova-compute[80928]:       <target dev="tapb3aee6c6-4e"/>
Nov 16 05:30:23 user nova-compute[80928]:     </interface>
Nov 16 05:30:23 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:30:23 user nova-compute[80928]:       <mac address="fa:16:3e:56:d2:9d"/>
Nov 16 05:30:23 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:30:23 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:30:23 user nova-compute[80928]:       <target dev="tap37120823-c2"/>
Nov 16 05:30:23 user nova-compute[80928]:     </interface>
Nov 16 05:30:23 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:30:23 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/1ff80388-e16c-41aa-966a-0446af885ba1/console.log" append="off"/>
Nov 16 05:30:23 user nova-compute[80928]:     </serial>
Nov 16 05:30:23 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:30:23 user nova-compute[80928]:     <video>
Nov 16 05:30:23 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:30:23 user nova-compute[80928]:     </video>
Nov 16 05:30:23 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:30:23 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:30:23 user nova-compute[80928]:     </rng>
Nov 16 05:30:23 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:30:23 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:30:23 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:30:23 user nova-compute[80928]:     </memballoon>
Nov 16 05:30:23 user nova-compute[80928]:   </devices>
Nov 16 05:30:23 user nova-compute[80928]: </domain>
Nov 16 05:30:23 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd1457c1-62ef-454f-961d-50effb0739d3", "address": "fa:16:3e:d7:88:d0", "network": {"id": "c4921244-898f-485d-83d9-27f2534bb016", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1221631381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1457c1-62", "ovs_interfaceid": "fd1457c1-62ef-454f-961d-50effb0739d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "fd1457c1-62ef-454f-961d-50effb0739d3", "address": "fa:16:3e:d7:88:d0", "network": {"id": "c4921244-898f-485d-83d9-27f2534bb016", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1221631381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1457c1-62", "ovs_interfaceid": "fd1457c1-62ef-454f-961d-50effb0739d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=fd1457c1-62ef-454f-961d-50effb0739d3,network=Network(c4921244-898f-485d-83d9-27f2534bb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1457c1-62') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=fd1457c1-62ef-454f-961d-50effb0739d3,network=Network(c4921244-898f-485d-83d9-27f2534bb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1457c1-62') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00583c84-8653-5804-9b54-32b015db379d', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd1457c1-62, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd1457c1-62, col_values=(('qos', UUID('615fdfb4-6cd8-423e-8bed-c553c5ae818b')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd1457c1-62, col_values=(('external_ids', {'iface-id': 'fd1457c1-62ef-454f-961d-50effb0739d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:88:d0', 'vm-uuid': '1ff80388-e16c-41aa-966a-0446af885ba1'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: INFO os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=fd1457c1-62ef-454f-961d-50effb0739d3,network=Network(c4921244-898f-485d-83d9-27f2534bb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1457c1-62')
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ab11ca7-0003-41bf-8689-6089a640da67", "address": "fa:16:3e:f5:4c:17", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab11ca7-00", "ovs_interfaceid": "3ab11ca7-0003-41bf-8689-6089a640da67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "3ab11ca7-0003-41bf-8689-6089a640da67", "address": "fa:16:3e:f5:4c:17", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab11ca7-00", "ovs_interfaceid": "3ab11ca7-0003-41bf-8689-6089a640da67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:4c:17,bridge_name='br-int',has_traffic_filtering=True,id=3ab11ca7-0003-41bf-8689-6089a640da67,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ab11ca7-00') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:4c:17,bridge_name='br-int',has_traffic_filtering=True,id=3ab11ca7-0003-41bf-8689-6089a640da67,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ab11ca7-00') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c1df542-8c66-559b-afd0-8e116219043a', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ab11ca7-00, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ab11ca7-00, col_values=(('qos', UUID('f1be1d27-a4bd-4091-9e9f-8321309942d8')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ab11ca7-00, col_values=(('external_ids', {'iface-id': '3ab11ca7-0003-41bf-8689-6089a640da67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:4c:17', 'vm-uuid': '1ff80388-e16c-41aa-966a-0446af885ba1'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: INFO os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:4c:17,bridge_name='br-int',has_traffic_filtering=True,id=3ab11ca7-0003-41bf-8689-6089a640da67,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ab11ca7-00')
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "address": "fa:16:3e:be:0a:cf", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef09bdc-d8", "ovs_interfaceid": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "address": "fa:16:3e:be:0a:cf", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef09bdc-d8", "ovs_interfaceid": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0a:cf,bridge_name='br-int',has_traffic_filtering=True,id=0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ef09bdc-d8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0a:cf,bridge_name='br-int',has_traffic_filtering=True,id=0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ef09bdc-d8') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '960829df-86ca-5452-9fe0-a4d825a08bf1', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ef09bdc-d8, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ef09bdc-d8, col_values=(('qos', UUID('8b1c488c-aaad-4c4e-a2f7-f2aa9edaa245')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ef09bdc-d8, col_values=(('external_ids', {'iface-id': '0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:0a:cf', 'vm-uuid': '1ff80388-e16c-41aa-966a-0446af885ba1'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: INFO os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0a:cf,bridge_name='br-int',has_traffic_filtering=True,id=0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ef09bdc-d8')
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31fe312e-632b-438e-aca2-3be48e901146", "address": "fa:16:3e:79:95:2f", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fe312e-63", "ovs_interfaceid": "31fe312e-632b-438e-aca2-3be48e901146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "31fe312e-632b-438e-aca2-3be48e901146", "address": "fa:16:3e:79:95:2f", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fe312e-63", "ovs_interfaceid": "31fe312e-632b-438e-aca2-3be48e901146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:95:2f,bridge_name='br-int',has_traffic_filtering=True,id=31fe312e-632b-438e-aca2-3be48e901146,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fe312e-63') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:95:2f,bridge_name='br-int',has_traffic_filtering=True,id=31fe312e-632b-438e-aca2-3be48e901146,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fe312e-63') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b9ee7f4-d426-5778-be43-3786777da327', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31fe312e-63, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31fe312e-63, col_values=(('qos', UUID('c48e19a5-94fe-45d5-b97e-7dbb1f436b07')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31fe312e-63, col_values=(('external_ids', {'iface-id': '31fe312e-632b-438e-aca2-3be48e901146', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:95:2f', 'vm-uuid': '1ff80388-e16c-41aa-966a-0446af885ba1'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: INFO os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:95:2f,bridge_name='br-int',has_traffic_filtering=True,id=31fe312e-632b-438e-aca2-3be48e901146,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fe312e-63')
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "address": "fa:16:3e:a6:eb:47", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cabd761-23", "ovs_interfaceid": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "address": "fa:16:3e:a6:eb:47", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cabd761-23", "ovs_interfaceid": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:eb:47,bridge_name='br-int',has_traffic_filtering=True,id=3cabd761-23fe-44ac-b3c7-9778cf0d9bfc,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cabd761-23') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:eb:47,bridge_name='br-int',has_traffic_filtering=True,id=3cabd761-23fe-44ac-b3c7-9778cf0d9bfc,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cabd761-23') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '152909a0-77fe-55af-a6e2-9b5c6c55202d', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cabd761-23, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3cabd761-23, col_values=(('qos', UUID('824af86e-54ac-4561-898a-a7c359ecb59f')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3cabd761-23, col_values=(('external_ids', {'iface-id': '3cabd761-23fe-44ac-b3c7-9778cf0d9bfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:eb:47', 'vm-uuid': '1ff80388-e16c-41aa-966a-0446af885ba1'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: INFO os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:eb:47,bridge_name='br-int',has_traffic_filtering=True,id=3cabd761-23fe-44ac-b3c7-9778cf0d9bfc,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cabd761-23')
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "address": "fa:16:3e:b1:08:68", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3aee6c6-4e", "ovs_interfaceid": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "address": "fa:16:3e:b1:08:68", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3aee6c6-4e", "ovs_interfaceid": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:08:68,bridge_name='br-int',has_traffic_filtering=True,id=b3aee6c6-4e9c-49b4-8555-08ff64eef094,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3aee6c6-4e') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:08:68,bridge_name='br-int',has_traffic_filtering=True,id=b3aee6c6-4e9c-49b4-8555-08ff64eef094,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3aee6c6-4e') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '202b7c49-b2c9-50fb-9615-42847330e55e', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3aee6c6-4e, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3aee6c6-4e, col_values=(('qos', UUID('cf74f673-2600-4e28-b350-cbfd1623e32f')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3aee6c6-4e, col_values=(('external_ids', {'iface-id': 'b3aee6c6-4e9c-49b4-8555-08ff64eef094', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:08:68', 'vm-uuid': '1ff80388-e16c-41aa-966a-0446af885ba1'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: INFO os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:08:68,bridge_name='br-int',has_traffic_filtering=True,id=b3aee6c6-4e9c-49b4-8555-08ff64eef094,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3aee6c6-4e')
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37120823-c20c-4315-ad71-ee3d35752385", "address": "fa:16:3e:56:d2:9d", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37120823-c2", "ovs_interfaceid": "37120823-c20c-4315-ad71-ee3d35752385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "37120823-c20c-4315-ad71-ee3d35752385", "address": "fa:16:3e:56:d2:9d", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37120823-c2", "ovs_interfaceid": "37120823-c20c-4315-ad71-ee3d35752385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=37120823-c20c-4315-ad71-ee3d35752385,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37120823-c2') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=37120823-c20c-4315-ad71-ee3d35752385,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37120823-c2') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '863c2276-57b7-55c9-8506-cf98df0eb7f2', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37120823-c2, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37120823-c2, col_values=(('qos', UUID('503cfd14-0494-47fc-b5f4-5534a1120ade')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37120823-c2, col_values=(('external_ids', {'iface-id': '37120823-c20c-4315-ad71-ee3d35752385', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:d2:9d', 'vm-uuid': '1ff80388-e16c-41aa-966a-0446af885ba1'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:23 user nova-compute[80928]: INFO os_vif [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=37120823-c20c-4315-ad71-ee3d35752385,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37120823-c2')
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] No BDM found with device name hda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] No BDM found with device name vdc, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] No VIF found with MAC fa:16:3e:d7:88:d0, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:30:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] No VIF found with MAC fa:16:3e:a6:eb:47, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:30:23 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Using config drive
Nov 16 05:30:24 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Creating config drive at /opt/stack/data/nova/instances/1ff80388-e16c-41aa-966a-0446af885ba1/disk.config
Nov 16 05:30:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1ff80388-e16c-41aa-966a-0446af885ba1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpknj4d113 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1ff80388-e16c-41aa-966a-0446af885ba1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpknj4d113" returned: 0 in 0.052s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d4363232-d414-4db1-b8fc-09ce8ce724f9 req-ae53f432-72ee-4558-beda-7b8013dfdcc5 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d4363232-d414-4db1-b8fc-09ce8ce724f9 req-ae53f432-72ee-4558-beda-7b8013dfdcc5 service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d4363232-d414-4db1-b8fc-09ce8ce724f9 req-ae53f432-72ee-4558-beda-7b8013dfdcc5 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d4363232-d414-4db1-b8fc-09ce8ce724f9 req-ae53f432-72ee-4558-beda-7b8013dfdcc5 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d4363232-d414-4db1-b8fc-09ce8ce724f9 req-ae53f432-72ee-4558-beda-7b8013dfdcc5 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:25 user nova-compute[80928]: WARNING nova.compute.manager [req-d4363232-d414-4db1-b8fc-09ce8ce724f9 req-ae53f432-72ee-4558-beda-7b8013dfdcc5 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-fd1457c1-62ef-454f-961d-50effb0739d3 for instance with vm_state building and task_state spawning.
Nov 16 05:30:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-dd4c1a4d-bfd1-4ef4-9678-13947e82e2c8 req-8c725f67-8b8f-4d06-a83b-aa2785cdc018 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dd4c1a4d-bfd1-4ef4-9678-13947e82e2c8 req-8c725f67-8b8f-4d06-a83b-aa2785cdc018 service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dd4c1a4d-bfd1-4ef4-9678-13947e82e2c8 req-8c725f67-8b8f-4d06-a83b-aa2785cdc018 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dd4c1a4d-bfd1-4ef4-9678-13947e82e2c8 req-8c725f67-8b8f-4d06-a83b-aa2785cdc018 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-dd4c1a4d-bfd1-4ef4-9678-13947e82e2c8 req-8c725f67-8b8f-4d06-a83b-aa2785cdc018 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:26 user nova-compute[80928]: WARNING nova.compute.manager [req-dd4c1a4d-bfd1-4ef4-9678-13947e82e2c8 req-8c725f67-8b8f-4d06-a83b-aa2785cdc018 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 for instance with vm_state building and task_state spawning.
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:27 user nova-compute[80928]: WARNING nova.compute.manager [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-fd1457c1-62ef-454f-961d-50effb0739d3 for instance with vm_state building and task_state spawning.
Nov 16 05:30:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:27 user nova-compute[80928]: WARNING nova.compute.manager [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-31fe312e-632b-438e-aca2-3be48e901146 for instance with vm_state building and task_state spawning.
Nov 16 05:30:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:27 user nova-compute[80928]: WARNING nova.compute.manager [req-aa57f960-87c8-4592-bf51-b589249f0880 req-2c9cc361-0b4b-4193-9c33-963a8cc129aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-31fe312e-632b-438e-aca2-3be48e901146 for instance with vm_state building and task_state spawning.
Nov 16 05:30:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:28 user nova-compute[80928]: WARNING nova.compute.manager [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 for instance with vm_state building and task_state spawning.
Nov 16 05:30:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:28 user nova-compute[80928]: WARNING nova.compute.manager [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-37120823-c20c-4315-ad71-ee3d35752385 for instance with vm_state building and task_state spawning.
Nov 16 05:30:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:28 user nova-compute[80928]: WARNING nova.compute.manager [req-8beda70f-d1ee-4395-a810-a498b77ce8db req-e76b03ad-3a43-4fe5-9752-2f4a4d68b0bb service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-37120823-c20c-4315-ad71-ee3d35752385 for instance with vm_state building and task_state spawning.
Nov 16 05:30:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:30:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:30:29 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Instance spawned successfully.
Nov 16 05:30:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:30:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:29 user nova-compute[80928]: INFO nova.compute.manager [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Took 10.76 seconds to spawn the instance on the hypervisor.
Nov 16 05:30:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:30:29 user nova-compute[80928]: INFO nova.compute.manager [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Took 30.17 seconds to build instance.
Nov 16 05:30:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0259cadf-87fe-4740-9c21-71e395f4dde0 tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "1ff80388-e16c-41aa-966a-0446af885ba1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.279s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-32ca1cc3-0b34-4013-94e9-4a9ead0c4bf5 req-1aaf9825-6e55-423c-bbe0-942b0ec90957 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-3ab11ca7-0003-41bf-8689-6089a640da67 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-32ca1cc3-0b34-4013-94e9-4a9ead0c4bf5 req-1aaf9825-6e55-423c-bbe0-942b0ec90957 service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-32ca1cc3-0b34-4013-94e9-4a9ead0c4bf5 req-1aaf9825-6e55-423c-bbe0-942b0ec90957 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-32ca1cc3-0b34-4013-94e9-4a9ead0c4bf5 req-1aaf9825-6e55-423c-bbe0-942b0ec90957 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-32ca1cc3-0b34-4013-94e9-4a9ead0c4bf5 req-1aaf9825-6e55-423c-bbe0-942b0ec90957 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-3ab11ca7-0003-41bf-8689-6089a640da67 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:30 user nova-compute[80928]: WARNING nova.compute.manager [req-32ca1cc3-0b34-4013-94e9-4a9ead0c4bf5 req-1aaf9825-6e55-423c-bbe0-942b0ec90957 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-3ab11ca7-0003-41bf-8689-6089a640da67 for instance with vm_state active and task_state None.
Nov 16 05:30:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:31 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:30:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:31 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:30:31 user nova-compute[80928]: INFO nova.compute.claims [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Claim successful on node user
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:30:32 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:30:32 user nova-compute[80928]: INFO nova.virt.block_device [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Booting with volume f530422d-5a49-40b4-a9ce-6d67b438dac4 at /dev/vda
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.policy [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f5ae21217cf4e70864e0331e403a82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd17a971f5d4b00b634af7f34b14adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-3ab11ca7-0003-41bf-8689-6089a640da67 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-3ab11ca7-0003-41bf-8689-6089a640da67 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:32 user nova-compute[80928]: WARNING nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-3ab11ca7-0003-41bf-8689-6089a640da67 for instance with vm_state active and task_state None.
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:32 user nova-compute[80928]: WARNING nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc for instance with vm_state active and task_state None.
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:32 user nova-compute[80928]: WARNING nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc for instance with vm_state active and task_state None.
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:32 user nova-compute[80928]: WARNING nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-b3aee6c6-4e9c-49b4-8555-08ff64eef094 for instance with vm_state active and task_state None.
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:32 user nova-compute[80928]: WARNING nova.compute.manager [req-2063e378-25c5-4cf7-bf48-9d9dd9d06b49 req-9cd50c2c-199e-4ec4-8dca-bed6664479aa service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-b3aee6c6-4e9c-49b4-8555-08ff64eef094 for instance with vm_state active and task_state None.
Nov 16 05:30:32 user nova-compute[80928]: DEBUG os_brick.utils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2902fa-6467-4622-9764-16416cf2f809]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bf5c17-b5a9-49e8-9649-3f64c64a277e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[44deb72e-5b75-4f77-ba17-68e86820e66a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[371264bc-9f5d-4613-ac26-ea74a4c32be9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:30:32 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:30:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d926b02-a002-482b-94bc-15874fe2897e]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:30:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:30:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:30:33 user nova-compute[80928]: DEBUG os_brick.utils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:30:33 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updating existing volume attachment record: e2fa7d49-aa1d-4715-a1d8-72b14efb2f30 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:30:33 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Successfully created port: 04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:30:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Successfully updated port: 04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquired lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-8b3cff29-cdd2-42f1-95ab-170561213fac req-15dc9c17-2b41-4b02-b6f2-10eb3831036c service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-changed-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-8b3cff29-cdd2-42f1-95ab-170561213fac req-15dc9c17-2b41-4b02-b6f2-10eb3831036c service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Refreshing instance network info cache due to event network-changed-04d9eb71-77a9-453e-94e3-b5356df3a824. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b3cff29-cdd2-42f1-95ab-170561213fac req-15dc9c17-2b41-4b02-b6f2-10eb3831036c service nova] Acquiring lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updating instance_info_cache with network_info: [{"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Releasing lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Instance network_info: |[{"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b3cff29-cdd2-42f1-95ab-170561213fac req-15dc9c17-2b41-4b02-b6f2-10eb3831036c service nova] Acquired lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG nova.network.neutron [req-8b3cff29-cdd2-42f1-95ab-170561213fac req-15dc9c17-2b41-4b02-b6f2-10eb3831036c service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Refreshing network info cache for port 04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG nova.network.neutron [req-8b3cff29-cdd2-42f1-95ab-170561213fac req-15dc9c17-2b41-4b02-b6f2-10eb3831036c service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updated VIF entry in instance network info cache for port 04d9eb71-77a9-453e-94e3-b5356df3a824. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:30:34 user nova-compute[80928]: DEBUG nova.network.neutron [req-8b3cff29-cdd2-42f1-95ab-170561213fac req-15dc9c17-2b41-4b02-b6f2-10eb3831036c service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updating instance_info_cache with network_info: [{"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b3cff29-cdd2-42f1-95ab-170561213fac req-15dc9c17-2b41-4b02-b6f2-10eb3831036c service nova] Releasing lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:30:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Creating image(s)
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Ensure instance console log exists: /opt/stack/data/nova/instances/30c2bba7-99d9-4eea-8569-bf726c6ba2c8/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Start _get_guest_xml network_info=[{"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfPUCdIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '30c2bba7-99d9-4eea-8569-bf726c6ba2c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f530422d-5a49-40b4-a9ce-6d67b438dac4', 'serial': 'f530422d-5a49-40b4-a9ce-6d67b438dac4'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e2fa7d49-aa1d-4715-a1d8-72b14efb2f30', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:30:38 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:30:38 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfPUCdIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:30:38 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:30:38 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:30:38 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5ed891-821a-467a-962d-c833943cb9b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:30:38 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[019d3d17-ef75-4d3c-8684-a88a596df6a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4] added
Nov 16 05:30:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8ffb5f-9ba7-4d3c-8e2e-c287c86a0f74]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bfa840-f337-454a-8a52-e29d5e23edf1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfPUCdIV {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfPUCdIV" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d72ff7-5b24-47f3-99d4-f31e52bb1cc0]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pfPUCdIV'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[18427882-ff53-48c2-b67b-73326c69043e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4771e46b-397e-4170-b0a1-bc69eb91dfb5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:38 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:38 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:30:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:38 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:38 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:30:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb70f349-6372-4075-935f-fb0b5f69fef3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260]
Nov 16 05:30:38 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260] successful.
Nov 16 05:30:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[066963ae-410e-4d1e-971e-31b14eff6450]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed534a10-cb87-4994-98d8-ab7a1d908f54]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:38 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:38 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:30:38 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:30:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:38 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:38 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:30:38 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:30:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aae3b9e-0a7f-4911-bfff-8336f08f6e1a]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfPUCdIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:30:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26434323838396139', 'path': '/dev/sde'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434323838396139', 'path': '/dev/sde'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1827874150',display_name='tempest-TestShelveInstance-server-1827874150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1827874150',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFWss00Sd4WQc30r+srzERolTutzspIKV/rkvXRQi/zJ8LopBV11TVD70W1JEyEYfSOK795SSzEE4eazoiRudHFx0MWgxud48bCYUdM+qaNBwOKSa4Ki/iqKRGsRldxRg==',key_name='tempest-TestShelveInstance-1824834473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bd17a971f5d4b00b634af7f34b14adc',ramdisk_id='',reservation_id='r-cdd685v9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-505947026',owner_user_name='tempest-TestShelveInstance-505947026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:33Z,user_data=None,user_id='7f5ae21217cf4e70864e0331e403a82f',uuid=30c2bba7-99d9-4eea-8569-bf726c6ba2c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Converting VIF {"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG nova.objects.instance [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lazy-loading 'pci_devices' on Instance uuid 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:30:39 user nova-compute[80928]:   <uuid>30c2bba7-99d9-4eea-8569-bf726c6ba2c8</uuid>
Nov 16 05:30:39 user nova-compute[80928]:   <name>instance-0000000b</name>
Nov 16 05:30:39 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:30:39 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:30:39 user nova-compute[80928]:   <metadata>
Nov 16 05:30:39 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:30:39 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:30:39 user nova-compute[80928]:       <nova:name>tempest-TestShelveInstance-server-1827874150</nova:name>
Nov 16 05:30:39 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:30:38</nova:creationTime>
Nov 16 05:30:39 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:30:39 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:30:39 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:30:39 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:30:39 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:30:39 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:30:39 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:30:39 user nova-compute[80928]:       <nova:owner>
Nov 16 05:30:39 user nova-compute[80928]:         <nova:user uuid="7f5ae21217cf4e70864e0331e403a82f">tempest-TestShelveInstance-505947026-project-member</nova:user>
Nov 16 05:30:39 user nova-compute[80928]:         <nova:project uuid="2bd17a971f5d4b00b634af7f34b14adc">tempest-TestShelveInstance-505947026</nova:project>
Nov 16 05:30:39 user nova-compute[80928]:       </nova:owner>
Nov 16 05:30:39 user nova-compute[80928]:       <nova:ports>
Nov 16 05:30:39 user nova-compute[80928]:         <nova:port uuid="04d9eb71-77a9-453e-94e3-b5356df3a824">
Nov 16 05:30:39 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 05:30:39 user nova-compute[80928]:         </nova:port>
Nov 16 05:30:39 user nova-compute[80928]:       </nova:ports>
Nov 16 05:30:39 user nova-compute[80928]:     </nova:instance>
Nov 16 05:30:39 user nova-compute[80928]:   </metadata>
Nov 16 05:30:39 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:30:39 user nova-compute[80928]:     <system>
Nov 16 05:30:39 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:30:39 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:30:39 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:30:39 user nova-compute[80928]:       <entry name="serial">30c2bba7-99d9-4eea-8569-bf726c6ba2c8</entry>
Nov 16 05:30:39 user nova-compute[80928]:       <entry name="uuid">30c2bba7-99d9-4eea-8569-bf726c6ba2c8</entry>
Nov 16 05:30:39 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:30:39 user nova-compute[80928]:     </system>
Nov 16 05:30:39 user nova-compute[80928]:   </sysinfo>
Nov 16 05:30:39 user nova-compute[80928]:   <os>
Nov 16 05:30:39 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:30:39 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:30:39 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:30:39 user nova-compute[80928]:   </os>
Nov 16 05:30:39 user nova-compute[80928]:   <features>
Nov 16 05:30:39 user nova-compute[80928]:     <acpi/>
Nov 16 05:30:39 user nova-compute[80928]:     <apic/>
Nov 16 05:30:39 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:30:39 user nova-compute[80928]:   </features>
Nov 16 05:30:39 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:30:39 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:30:39 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:30:39 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:30:39 user nova-compute[80928]:   </clock>
Nov 16 05:30:39 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:30:39 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:30:39 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:30:39 user nova-compute[80928]:   </cpu>
Nov 16 05:30:39 user nova-compute[80928]:   <devices>
Nov 16 05:30:39 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:30:39 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:30:39 user nova-compute[80928]:       <source dev="/dev/sde"/>
Nov 16 05:30:39 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:30:39 user nova-compute[80928]:       <serial>f530422d-5a49-40b4-a9ce-6d67b438dac4</serial>
Nov 16 05:30:39 user nova-compute[80928]:     </disk>
Nov 16 05:30:39 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:30:39 user nova-compute[80928]:       <mac address="fa:16:3e:ad:86:90"/>
Nov 16 05:30:39 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:30:39 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:30:39 user nova-compute[80928]:       <target dev="tap04d9eb71-77"/>
Nov 16 05:30:39 user nova-compute[80928]:     </interface>
Nov 16 05:30:39 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:30:39 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/30c2bba7-99d9-4eea-8569-bf726c6ba2c8/console.log" append="off"/>
Nov 16 05:30:39 user nova-compute[80928]:     </serial>
Nov 16 05:30:39 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:30:39 user nova-compute[80928]:     <video>
Nov 16 05:30:39 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:30:39 user nova-compute[80928]:     </video>
Nov 16 05:30:39 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:30:39 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:30:39 user nova-compute[80928]:     </rng>
Nov 16 05:30:39 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:30:39 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:30:39 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:30:39 user nova-compute[80928]:     </memballoon>
Nov 16 05:30:39 user nova-compute[80928]:   </devices>
Nov 16 05:30:39 user nova-compute[80928]: </domain>
Nov 16 05:30:39 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1827874150',display_name='tempest-TestShelveInstance-server-1827874150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1827874150',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFWss00Sd4WQc30r+srzERolTutzspIKV/rkvXRQi/zJ8LopBV11TVD70W1JEyEYfSOK795SSzEE4eazoiRudHFx0MWgxud48bCYUdM+qaNBwOKSa4Ki/iqKRGsRldxRg==',key_name='tempest-TestShelveInstance-1824834473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bd17a971f5d4b00b634af7f34b14adc',ramdisk_id='',reservation_id='r-cdd685v9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-505947026',owner_user_name='tempest-TestShelveInstance-505947026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:33Z,user_data=None,user_id='7f5ae21217cf4e70864e0331e403a82f',uuid=30c2bba7-99d9-4eea-8569-bf726c6ba2c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Converting VIF {"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG os_vif [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57a5e823-8c8d-52bd-854d-f81805e29e96', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04d9eb71-77, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04d9eb71-77, col_values=(('qos', UUID('0212d661-1606-427d-927c-b64f79c0b9d6')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04d9eb71-77, col_values=(('external_ids', {'iface-id': '04d9eb71-77a9-453e-94e3-b5356df3a824', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:86:90', 'vm-uuid': '30c2bba7-99d9-4eea-8569-bf726c6ba2c8'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:40 user nova-compute[80928]: INFO os_vif [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77')
Nov 16 05:30:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:30:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] No VIF found with MAC fa:16:3e:ad:86:90, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:30:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-ae44e453-bad6-487c-a289-f31de9b76066 req-2c70548e-efe4-4003-aa01-d582fdcd663b service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ae44e453-bad6-487c-a289-f31de9b76066 req-2c70548e-efe4-4003-aa01-d582fdcd663b service nova] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ae44e453-bad6-487c-a289-f31de9b76066 req-2c70548e-efe4-4003-aa01-d582fdcd663b service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ae44e453-bad6-487c-a289-f31de9b76066 req-2c70548e-efe4-4003-aa01-d582fdcd663b service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-ae44e453-bad6-487c-a289-f31de9b76066 req-2c70548e-efe4-4003-aa01-d582fdcd663b service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] No waiting events found dispatching network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:41 user nova-compute[80928]: WARNING nova.compute.manager [req-ae44e453-bad6-487c-a289-f31de9b76066 req-2c70548e-efe4-4003-aa01-d582fdcd663b service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received unexpected event network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 for instance with vm_state building and task_state spawning.
Nov 16 05:30:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:30:43 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Instance spawned successfully.
Nov 16 05:30:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:43 user nova-compute[80928]: INFO nova.compute.manager [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 16 05:30:43 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG nova.compute.manager [req-99d74f50-8392-4549-9d00-ff149beadf19 req-44104ff4-8e91-41d7-bc62-a1cc558445b1 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-99d74f50-8392-4549-9d00-ff149beadf19 req-44104ff4-8e91-41d7-bc62-a1cc558445b1 service nova] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-99d74f50-8392-4549-9d00-ff149beadf19 req-44104ff4-8e91-41d7-bc62-a1cc558445b1 service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-99d74f50-8392-4549-9d00-ff149beadf19 req-44104ff4-8e91-41d7-bc62-a1cc558445b1 service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:43 user nova-compute[80928]: DEBUG nova.compute.manager [req-99d74f50-8392-4549-9d00-ff149beadf19 req-44104ff4-8e91-41d7-bc62-a1cc558445b1 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] No waiting events found dispatching network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:43 user nova-compute[80928]: WARNING nova.compute.manager [req-99d74f50-8392-4549-9d00-ff149beadf19 req-44104ff4-8e91-41d7-bc62-a1cc558445b1 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received unexpected event network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 for instance with vm_state building and task_state spawning.
Nov 16 05:30:43 user nova-compute[80928]: INFO nova.compute.manager [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Took 11.85 seconds to build instance.
Nov 16 05:30:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8b760018-4f95-4829-bf8f-553e798fc19a tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.948s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:46 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:30:46 user nova-compute[80928]: INFO nova.compute.manager [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] instance snapshotting
Nov 16 05:30:46 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Beginning live snapshot process
Nov 16 05:30:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json -f qcow2 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json -f qcow2" returned: 0 in 0.793s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json -f qcow2 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "c2e7a068-ab7d-4814-8337-b8f663188a5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:47 user nova-compute[80928]: DEBUG nova.compute.manager [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:30:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:47 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:30:47 user nova-compute[80928]: INFO nova.compute.claims [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Claim successful on node user
Nov 16 05:30:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.192s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyp4b2v7s/b6ecb926d1a14aa5a52f3ec452233dd2.delta 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyp4b2v7s/b6ecb926d1a14aa5a52f3ec452233dd2.delta 1073741824" returned: 0 in 0.125s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:48 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 05:30:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Checking UEFI support for host arch (x86_64) {{(pid=80928) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 16 05:30:48 user nova-compute[80928]: INFO nova.virt.libvirt.host [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] UEFI support detected
Nov 16 05:30:48 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.645s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG nova.network.neutron [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:30:48 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:30:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG nova.policy [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b904db715308497cbd24bfd51a34d0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a972c7cdc45e79d788c35ac613b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:30:48 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Creating image(s)
Nov 16 05:30:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "/opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "/opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.218s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk 1073741824" returned: 0 in 0.125s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG nova.network.neutron [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Successfully created port: 9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.235s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:30:49 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 05:30:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Cannot resize image /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Ensure instance console log exists: /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyp4b2v7s/b6ecb926d1a14aa5a52f3ec452233dd2.delta /opt/stack/data/nova/instances/snapshots/tmpyp4b2v7s/b6ecb926d1a14aa5a52f3ec452233dd2 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG nova.network.neutron [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Successfully updated port: 9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:30:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "refresh_cache-c2e7a068-ab7d-4814-8337-b8f663188a5d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquired lock "refresh_cache-c2e7a068-ab7d-4814-8337-b8f663188a5d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.network.neutron [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-524729a6-3dd2-4edc-9a7e-b6cf6c3904cb req-726ad4ed-b1d9-431e-bcb3-ee495bd7ebdf service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Received event network-changed-9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-524729a6-3dd2-4edc-9a7e-b6cf6c3904cb req-726ad4ed-b1d9-431e-bcb3-ee495bd7ebdf service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Refreshing instance network info cache due to event network-changed-9d6d65d0-c074-438a-a7fa-1422c64d78ac. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-524729a6-3dd2-4edc-9a7e-b6cf6c3904cb req-726ad4ed-b1d9-431e-bcb3-ee495bd7ebdf service nova] Acquiring lock "refresh_cache-c2e7a068-ab7d-4814-8337-b8f663188a5d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.network.neutron [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyp4b2v7s/b6ecb926d1a14aa5a52f3ec452233dd2.delta /opt/stack/data/nova/instances/snapshots/tmpyp4b2v7s/b6ecb926d1a14aa5a52f3ec452233dd2" returned: 0 in 0.991s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Snapshot extracted, beginning image upload
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.network.neutron [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Updating instance_info_cache with network_info: [{"id": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "address": "fa:16:3e:d2:b4:d0", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6d65d0-c0", "ovs_interfaceid": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Releasing lock "refresh_cache-c2e7a068-ab7d-4814-8337-b8f663188a5d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Instance network_info: |[{"id": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "address": "fa:16:3e:d2:b4:d0", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6d65d0-c0", "ovs_interfaceid": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-524729a6-3dd2-4edc-9a7e-b6cf6c3904cb req-726ad4ed-b1d9-431e-bcb3-ee495bd7ebdf service nova] Acquired lock "refresh_cache-c2e7a068-ab7d-4814-8337-b8f663188a5d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.network.neutron [req-524729a6-3dd2-4edc-9a7e-b6cf6c3904cb req-726ad4ed-b1d9-431e-bcb3-ee495bd7ebdf service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Refreshing network info cache for port 9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Start _get_guest_xml network_info=[{"id": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "address": "fa:16:3e:d2:b4:d0", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6d65d0-c0", "ovs_interfaceid": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:30:50 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:30:50 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2043310304',display_name='tempest-ServersNegativeTestJSON-server-2043310304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2043310304',id=12,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b31a972c7cdc45e79d788c35ac613b0e',ramdisk_id='',reservation_id='r-dlegeut8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1596712159',owner_user_name='tempest-ServersNegativeTestJSON-1596712159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:49Z,user_data=None,user_id='b904db715308497cbd24bfd51a34d0f9',uuid=c2e7a068-ab7d-4814-8337-b8f663188a5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "address": "fa:16:3e:d2:b4:d0", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6d65d0-c0", "ovs_interfaceid": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Converting VIF {"id": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "address": "fa:16:3e:d2:b4:d0", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6d65d0-c0", "ovs_interfaceid": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=9d6d65d0-c074-438a-a7fa-1422c64d78ac,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6d65d0-c0') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.objects.instance [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lazy-loading 'pci_devices' on Instance uuid c2e7a068-ab7d-4814-8337-b8f663188a5d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:30:50 user nova-compute[80928]:   <uuid>c2e7a068-ab7d-4814-8337-b8f663188a5d</uuid>
Nov 16 05:30:50 user nova-compute[80928]:   <name>instance-0000000c</name>
Nov 16 05:30:50 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:30:50 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:30:50 user nova-compute[80928]:   <metadata>
Nov 16 05:30:50 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:30:50 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:30:50 user nova-compute[80928]:       <nova:name>tempest-ServersNegativeTestJSON-server-2043310304</nova:name>
Nov 16 05:30:50 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:30:50</nova:creationTime>
Nov 16 05:30:50 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:30:50 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:30:50 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:30:50 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:30:50 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:30:50 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:30:50 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:30:50 user nova-compute[80928]:       <nova:owner>
Nov 16 05:30:50 user nova-compute[80928]:         <nova:user uuid="b904db715308497cbd24bfd51a34d0f9">tempest-ServersNegativeTestJSON-1596712159-project-member</nova:user>
Nov 16 05:30:50 user nova-compute[80928]:         <nova:project uuid="b31a972c7cdc45e79d788c35ac613b0e">tempest-ServersNegativeTestJSON-1596712159</nova:project>
Nov 16 05:30:50 user nova-compute[80928]:       </nova:owner>
Nov 16 05:30:50 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:30:50 user nova-compute[80928]:       <nova:ports>
Nov 16 05:30:50 user nova-compute[80928]:         <nova:port uuid="9d6d65d0-c074-438a-a7fa-1422c64d78ac">
Nov 16 05:30:50 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:30:50 user nova-compute[80928]:         </nova:port>
Nov 16 05:30:50 user nova-compute[80928]:       </nova:ports>
Nov 16 05:30:50 user nova-compute[80928]:     </nova:instance>
Nov 16 05:30:50 user nova-compute[80928]:   </metadata>
Nov 16 05:30:50 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:30:50 user nova-compute[80928]:     <system>
Nov 16 05:30:50 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:30:50 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:30:50 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:30:50 user nova-compute[80928]:       <entry name="serial">c2e7a068-ab7d-4814-8337-b8f663188a5d</entry>
Nov 16 05:30:50 user nova-compute[80928]:       <entry name="uuid">c2e7a068-ab7d-4814-8337-b8f663188a5d</entry>
Nov 16 05:30:50 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:30:50 user nova-compute[80928]:     </system>
Nov 16 05:30:50 user nova-compute[80928]:   </sysinfo>
Nov 16 05:30:50 user nova-compute[80928]:   <os>
Nov 16 05:30:50 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:30:50 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:30:50 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:30:50 user nova-compute[80928]:   </os>
Nov 16 05:30:50 user nova-compute[80928]:   <features>
Nov 16 05:30:50 user nova-compute[80928]:     <acpi/>
Nov 16 05:30:50 user nova-compute[80928]:     <apic/>
Nov 16 05:30:50 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:30:50 user nova-compute[80928]:   </features>
Nov 16 05:30:50 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:30:50 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:30:50 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:30:50 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:30:50 user nova-compute[80928]:   </clock>
Nov 16 05:30:50 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:30:50 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:30:50 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:30:50 user nova-compute[80928]:   </cpu>
Nov 16 05:30:50 user nova-compute[80928]:   <devices>
Nov 16 05:30:50 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:30:50 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:30:50 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk"/>
Nov 16 05:30:50 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:30:50 user nova-compute[80928]:     </disk>
Nov 16 05:30:50 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:30:50 user nova-compute[80928]:       <mac address="fa:16:3e:d2:b4:d0"/>
Nov 16 05:30:50 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:30:50 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:30:50 user nova-compute[80928]:       <target dev="tap9d6d65d0-c0"/>
Nov 16 05:30:50 user nova-compute[80928]:     </interface>
Nov 16 05:30:50 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:30:50 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/console.log" append="off"/>
Nov 16 05:30:50 user nova-compute[80928]:     </serial>
Nov 16 05:30:50 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:30:50 user nova-compute[80928]:     <video>
Nov 16 05:30:50 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:30:50 user nova-compute[80928]:     </video>
Nov 16 05:30:50 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:30:50 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:30:50 user nova-compute[80928]:     </rng>
Nov 16 05:30:50 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:30:50 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:30:50 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:30:50 user nova-compute[80928]:     </memballoon>
Nov 16 05:30:50 user nova-compute[80928]:   </devices>
Nov 16 05:30:50 user nova-compute[80928]: </domain>
Nov 16 05:30:50 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2043310304',display_name='tempest-ServersNegativeTestJSON-server-2043310304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2043310304',id=12,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b31a972c7cdc45e79d788c35ac613b0e',ramdisk_id='',reservation_id='r-dlegeut8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1596712159',owner_user_name='tempest-ServersNegativeTestJSON-1596712159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:30:49Z,user_data=None,user_id='b904db715308497cbd24bfd51a34d0f9',uuid=c2e7a068-ab7d-4814-8337-b8f663188a5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "address": "fa:16:3e:d2:b4:d0", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6d65d0-c0", "ovs_interfaceid": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Converting VIF {"id": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "address": "fa:16:3e:d2:b4:d0", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6d65d0-c0", "ovs_interfaceid": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=9d6d65d0-c074-438a-a7fa-1422c64d78ac,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6d65d0-c0') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG os_vif [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=9d6d65d0-c074-438a-a7fa-1422c64d78ac,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6d65d0-c0') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3e12566-6a64-59ce-a74e-1b1d9d917d6d', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d6d65d0-c0, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d6d65d0-c0, col_values=(('qos', UUID('e3afdfa3-e077-4eaa-a072-291b796d7ad2')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d6d65d0-c0, col_values=(('external_ids', {'iface-id': '9d6d65d0-c074-438a-a7fa-1422c64d78ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:b4:d0', 'vm-uuid': 'c2e7a068-ab7d-4814-8337-b8f663188a5d'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:50 user nova-compute[80928]: INFO os_vif [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=9d6d65d0-c074-438a-a7fa-1422c64d78ac,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6d65d0-c0')
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:30:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] No VIF found with MAC fa:16:3e:d2:b4:d0, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:30:51 user nova-compute[80928]: DEBUG nova.network.neutron [req-524729a6-3dd2-4edc-9a7e-b6cf6c3904cb req-726ad4ed-b1d9-431e-bcb3-ee495bd7ebdf service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Updated VIF entry in instance network info cache for port 9d6d65d0-c074-438a-a7fa-1422c64d78ac. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:30:51 user nova-compute[80928]: DEBUG nova.network.neutron [req-524729a6-3dd2-4edc-9a7e-b6cf6c3904cb req-726ad4ed-b1d9-431e-bcb3-ee495bd7ebdf service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Updating instance_info_cache with network_info: [{"id": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "address": "fa:16:3e:d2:b4:d0", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6d65d0-c0", "ovs_interfaceid": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-524729a6-3dd2-4edc-9a7e-b6cf6c3904cb req-726ad4ed-b1d9-431e-bcb3-ee495bd7ebdf service nova] Releasing lock "refresh_cache-c2e7a068-ab7d-4814-8337-b8f663188a5d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:30:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "983eadda-f7cc-410c-91b5-62082cefe9ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:51 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lazy-loading 'flavor' on Instance uuid 983eadda-f7cc-410c-91b5-62082cefe9ca {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.261s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "983eadda-f7cc-410c-91b5-62082cefe9ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:52 user nova-compute[80928]: INFO nova.compute.manager [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Attaching volume a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 to /dev/vdb
Nov 16 05:30:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG os_brick.utils [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ff110d-93b7-4e12-8a63-78b1d790fcda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eff7874-ed91-46a9-9bf4-855e87e95c6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb96420-bb7d-47c9-8e5a-eb9d817ae6bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[773353c0-4226-4d94-bd98-ec619c8e9388]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:30:52 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01b103b-29e5-42ae-8182-de6c4fd4fa95]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG os_brick.utils [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Updating existing volume attachment record: 7f3b1bc2-b16b-4e2b-b63f-20c903fbcd90 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:30:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-29d48540-f235-46e3-a89b-3372b34a0631 req-53d80ead-9311-4688-9c2d-3f56f67d74b6 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Received event network-vif-plugged-9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-29d48540-f235-46e3-a89b-3372b34a0631 req-53d80ead-9311-4688-9c2d-3f56f67d74b6 service nova] Acquiring lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-29d48540-f235-46e3-a89b-3372b34a0631 req-53d80ead-9311-4688-9c2d-3f56f67d74b6 service nova] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-29d48540-f235-46e3-a89b-3372b34a0631 req-53d80ead-9311-4688-9c2d-3f56f67d74b6 service nova] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-29d48540-f235-46e3-a89b-3372b34a0631 req-53d80ead-9311-4688-9c2d-3f56f67d74b6 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] No waiting events found dispatching network-vif-plugged-9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:53 user nova-compute[80928]: WARNING nova.compute.manager [req-29d48540-f235-46e3-a89b-3372b34a0631 req-53d80ead-9311-4688-9c2d-3f56f67d74b6 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Received unexpected event network-vif-plugged-9d6d65d0-c074-438a-a7fa-1422c64d78ac for instance with vm_state building and task_state spawning.
Nov 16 05:30:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-b9172c08-e031-4b5b-be9e-8c6da07c833e req-bfe1550c-5ce6-41f3-9c92-1ea3baaf691b service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Received event network-changed-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-b9172c08-e031-4b5b-be9e-8c6da07c833e req-bfe1550c-5ce6-41f3-9c92-1ea3baaf691b service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Refreshing instance network info cache due to event network-changed-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:30:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b9172c08-e031-4b5b-be9e-8c6da07c833e req-bfe1550c-5ce6-41f3-9c92-1ea3baaf691b service nova] Acquiring lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b9172c08-e031-4b5b-be9e-8c6da07c833e req-bfe1550c-5ce6-41f3-9c92-1ea3baaf691b service nova] Acquired lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:53 user nova-compute[80928]: DEBUG nova.network.neutron [req-b9172c08-e031-4b5b-be9e-8c6da07c833e req-bfe1550c-5ce6-41f3-9c92-1ea3baaf691b service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Refreshing network info cache for port 9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:30:53 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Snapshot image upload complete
Nov 16 05:30:53 user nova-compute[80928]: INFO nova.compute.manager [None req-e848c83f-2aff-440e-955f-09ca37283379 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Took 7.30 seconds to snapshot the instance on the hypervisor.
Nov 16 05:30:54 user nova-compute[80928]: DEBUG nova.network.neutron [req-b9172c08-e031-4b5b-be9e-8c6da07c833e req-bfe1550c-5ce6-41f3-9c92-1ea3baaf691b service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updated VIF entry in instance network info cache for port 9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG nova.network.neutron [req-b9172c08-e031-4b5b-be9e-8c6da07c833e req-bfe1550c-5ce6-41f3-9c92-1ea3baaf691b service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updating instance_info_cache with network_info: [{"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b9172c08-e031-4b5b-be9e-8c6da07c833e req-bfe1550c-5ce6-41f3-9c92-1ea3baaf691b service nova] Releasing lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:30:54 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Instance spawned successfully.
Nov 16 05:30:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:30:55 user nova-compute[80928]: INFO nova.compute.manager [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Took 6.45 seconds to spawn the instance on the hypervisor.
Nov 16 05:30:55 user nova-compute[80928]: DEBUG nova.compute.manager [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:55 user nova-compute[80928]: INFO nova.compute.manager [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Took 7.48 seconds to build instance.
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72f538d8-a154-4f9f-b745-358dcf8968b1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.596s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Received event network-vif-plugged-9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] Acquiring lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] No waiting events found dispatching network-vif-plugged-9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:30:55 user nova-compute[80928]: WARNING nova.compute.manager [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Received unexpected event network-vif-plugged-9d6d65d0-c074-438a-a7fa-1422c64d78ac for instance with vm_state active and task_state None.
Nov 16 05:30:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Received event network-changed-5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Refreshing instance network info cache due to event network-changed-5ce19f2d-3fba-45ff-beb2-91952d77e21a. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] Acquiring lock "refresh_cache-5687e588-1245-42a9-b2d8-306c3c6bf8c5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] Acquired lock "refresh_cache-5687e588-1245-42a9-b2d8-306c3c6bf8c5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG nova.network.neutron [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Refreshing network info cache for port 5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'flavor' on Instance uuid 5687e588-1245-42a9-b2d8-306c3c6bf8c5 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:30:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.141s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG nova.network.neutron [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Updated VIF entry in instance network info cache for port 5ce19f2d-3fba-45ff-beb2-91952d77e21a. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG nova.network.neutron [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Updating instance_info_cache with network_info: [{"id": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "address": "fa:16:3e:41:e0:38", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce19f2d-3f", "ovs_interfaceid": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-da37bc02-d6c6-414f-ba5a-6529a8611031 req-95d5aa93-e104-454e-a718-5c15a552afb1 service nova] Releasing lock "refresh_cache-5687e588-1245-42a9-b2d8-306c3c6bf8c5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:56 user nova-compute[80928]: INFO nova.compute.manager [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Attaching volume a647a8dd-46fe-40a4-9628-79364cacf96a to /dev/vdb
Nov 16 05:30:56 user nova-compute[80928]: DEBUG os_brick.utils [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ae8371-b750-4853-b644-9feb7cce75ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd65a8e-d52f-4cf6-ba44-fa12b531440c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[00abf152-99ec-4744-a0fb-10a30293f5da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd85643b-81ec-4e3f-85d2-63e9caca94de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:30:56 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d355c0-2691-459e-b8ab-1a24282293fd]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG os_brick.utils [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Updating existing volume attachment record: 65be1718-31a7-4e42-8e2c-343a9f46cc1d {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:30:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OoaqsNbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:30:58 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:30:58 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:30:58 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b79451-4181-4dbe-8323-f7ce0dbb8aa5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:30:58 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a44fa2-7337-41ad-a328-635eadfb5362]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211] added
Nov 16 05:30:58 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cbad3d-54d7-40c5-a2f2-b146d70dc3f8]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1175b79-3142-49fa-9d8a-76f41cb12ada]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OoaqsNbz {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OoaqsNbz" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61e3334-939f-4975-a82b-54944b1492f2]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OoaqsNbz'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[97098319-8332-4dd3-8585-bd82583a0547]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4b55de-8e4e-48f6-8ca0-233a4edd5b93]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed723c50-35ce-4136-9876-f869cbc83924]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211, portal: 172.16.0.220,3260]
Nov 16 05:30:58 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211, portal: 172.16.0.220,3260] successful.
Nov 16 05:30:58 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d9b7d-25a0-4552-bb4d-d51795fa2275]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f9b47c-7b28-4931-8d1d-58f86caf43e2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 (non-flash)
Nov 16 05:30:58 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[613430c3-0368-4616-96cf-d6e5fb21acc2]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OoaqsNbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:30:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:30:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.707s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:30:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] <== connect_volume: return (1710ms) {'type': 'block', 'scsi_wwn': '26332623435303263', 'path': '/dev/sdf'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:30:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332623435303263', 'path': '/dev/sdf'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:30:59 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:30:59 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:30:59 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=6918MB free_disk=25.628192901611328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:30:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:30:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:30:59 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lazy-loading 'flavor' on Instance uuid 983eadda-f7cc-410c-91b5-62082cefe9ca {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:30:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:30:59 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:30:59 user nova-compute[80928]:   <source dev="/dev/sdf"/>
Nov 16 05:30:59 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:30:59 user nova-compute[80928]:   <serial>a942e1e3-7a77-42cd-9cb8-ce2c97d4b211</serial>
Nov 16 05:30:59 user nova-compute[80928]: </disk>
Nov 16 05:30:59 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5d03bda0-20b8-497a-a87b-faee21624468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 983eadda-f7cc-410c-91b5-62082cefe9ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5687e588-1245-42a9-b2d8-306c3c6bf8c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 556f0ce2-2601-4bbe-9b0d-d70061cdc955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance e8a6c1a3-ddb9-4a38-86a5-420afe793380 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance f3367d72-f511-4285-a77b-b26932bf7490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 1ff80388-e16c-41aa-966a-0446af885ba1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance c2e7a068-ab7d-4814-8337-b8f663188a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] No VIF found with MAC fa:16:3e:e7:60:ed, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c73360d0-1df3-41e5-868a-b25fd6a16a8a tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.239s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "983eadda-f7cc-410c-91b5-62082cefe9ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:01 user nova-compute[80928]: INFO nova.compute.manager [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Terminating instance
Nov 16 05:31:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-3e650d4d-3bd2-4ecb-a8bc-15328c8d329f req-c4e6cab2-3802-49f4-83e6-683ff52ec154 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Received event network-vif-unplugged-116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3e650d4d-3bd2-4ecb-a8bc-15328c8d329f req-c4e6cab2-3802-49f4-83e6-683ff52ec154 service nova] Acquiring lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3e650d4d-3bd2-4ecb-a8bc-15328c8d329f req-c4e6cab2-3802-49f4-83e6-683ff52ec154 service nova] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3e650d4d-3bd2-4ecb-a8bc-15328c8d329f req-c4e6cab2-3802-49f4-83e6-683ff52ec154 service nova] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-3e650d4d-3bd2-4ecb-a8bc-15328c8d329f req-c4e6cab2-3802-49f4-83e6-683ff52ec154 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] No waiting events found dispatching network-vif-unplugged-116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-3e650d4d-3bd2-4ecb-a8bc-15328c8d329f req-c4e6cab2-3802-49f4-83e6-683ff52ec154 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Received event network-vif-unplugged-116f20fc-ab87-4a6a-983d-57d79b42b0a1 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-5d03bda0-20b8-497a-a87b-faee21624468" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-5d03bda0-20b8-497a-a87b-faee21624468" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:31:01 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Instance destroyed successfully.
Nov 16 05:31:01 user nova-compute[80928]: DEBUG nova.objects.instance [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lazy-loading 'resources' on Instance uuid 983eadda-f7cc-410c-91b5-62082cefe9ca {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:28:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1377853669',display_name='tempest-DeleteServersTestJSON-server-1377853669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1377853669',id=3,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:29:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='416ba3a5f17c4673bf6ea5bad9be09b0',ramdisk_id='',reservation_id='r-szn1pfau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1669441791',owner_user_name='tempest-DeleteServersTestJSON-1669441791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:29:15Z,user_data=None,user_id='6a72a860e8214b51bb1111442dee406d',uuid=983eadda-f7cc-410c-91b5-62082cefe9ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "address": "fa:16:3e:e7:60:ed", "network": {"id": "8d554e46-58f4-4d65-9428-8463c6cf2645", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-119277987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "416ba3a5f17c4673bf6ea5bad9be09b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116f20fc-ab", "ovs_interfaceid": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Converting VIF {"id": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "address": "fa:16:3e:e7:60:ed", "network": {"id": "8d554e46-58f4-4d65-9428-8463c6cf2645", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-119277987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "416ba3a5f17c4673bf6ea5bad9be09b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116f20fc-ab", "ovs_interfaceid": "116f20fc-ab87-4a6a-983d-57d79b42b0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=116f20fc-ab87-4a6a-983d-57d79b42b0a1,network=Network(8d554e46-58f4-4d65-9428-8463c6cf2645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116f20fc-ab') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG os_vif [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=116f20fc-ab87-4a6a-983d-57d79b42b0a1,network=Network(8d554e46-58f4-4d65-9428-8463c6cf2645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116f20fc-ab') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap116f20fc-ab, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=471966d3-fcca-4a62-9e37-f0c904cb7064) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:01 user nova-compute[80928]: INFO os_vif [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:60:ed,bridge_name='br-int',has_traffic_filtering=True,id=116f20fc-ab87-4a6a-983d-57d79b42b0a1,network=Network(8d554e46-58f4-4d65-9428-8463c6cf2645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap116f20fc-ab')
Nov 16 05:31:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OoaqsNbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:01 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b413e0e4-45d3-454a-833b-3578ddcc7111]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:31:01 user nova-compute[80928]: No targets found.
Nov 16 05:31:01 user nova-compute[80928]: iSNS:
Nov 16 05:31:01 user nova-compute[80928]: No targets found.
Nov 16 05:31:01 user nova-compute[80928]: STATIC:
Nov 16 05:31:01 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b
Nov 16 05:31:01 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:01 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:01 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211
Nov 16 05:31:01 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:01 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:01 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05
Nov 16 05:31:01 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:01 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:01 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:31:01 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:01 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:01 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2
Nov 16 05:31:01 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:01 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:01 user nova-compute[80928]: FIRMWARE:
Nov 16 05:31:01 user nova-compute[80928]: No targets found.
Nov 16 05:31:01 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:31:01 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:31:01 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9f875b-c189-496c-ac5b-f39a216b7be4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a63eb4-d1a0-4e41-84a5-c9b6cf210398]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8678231090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211'): ({'sdf'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Removing single pathed devices sdf {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd029d8-1b0e-4ed2-aef8-5742b6926db0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[725e370a-15e7-471e-bcfb-885cff977045]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Flushing IO for device /dev/sdf {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfee45f-5fe6-4c88-ab89-a477352246a6]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyjrQIzP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:02 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1079ba10-50e3-46c1-b048-5e1d3964ad92]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] SCSI volumes sdf have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Updating instance_info_cache with network_info: [{"id": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "address": "fa:16:3e:57:d0:dd", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af67efa-d1", "ovs_interfaceid": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea5724b-4510-42af-82c3-2ac814e616ae]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-5d03bda0-20b8-497a-a87b-faee21624468" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[14198dbc-19a6-4a3d-8e76-ad5264541364]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211, portal: 172.16.0.220,3260]
Nov 16 05:31:02 user nova-compute[80928]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a942e1e3-7a77-42cd-9cb8-ce2c97d4b211 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f8534f-0aac-484c-bef9-a29920f3e467]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] <== disconnect_volume: return (305ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:31:02 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Deleting instance files /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca_del
Nov 16 05:31:02 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Deletion of /opt/stack/data/nova/instances/983eadda-f7cc-410c-91b5-62082cefe9ca_del complete
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.131s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:02 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:02 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b242a8e-ec8e-4fa5-a79d-e45920e1862d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:31:02 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b500421f-0a5d-4b76-97aa-96c2e91e6bfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a] added
Nov 16 05:31:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: INFO nova.compute.manager [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd6537e-c12d-43a6-8da8-8db8ea4b4530]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8da911-d4d5-4fe3-905e-cdde64adf512]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyjrQIzP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyjrQIzP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[52af5387-e5fe-419d-9495-248504fbd5db]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tyjrQIzP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[686f3e2f-cfb0-49fd-af6d-10fbb77301fd]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a7f87c-2ae3-4c24-99e8-5f259816143e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[872f1e92-a48c-4acc-9212-7c0f7a2e66bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a, portal: 172.16.0.220,3260]
Nov 16 05:31:02 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8d8b55-f782-440d-abcd-5b0ea6566504]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c66a439-db3a-41f3-92bc-8d036af021c2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:02 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e65ed7b-dc94-47da-8e26-8566eb220b8f]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyjrQIzP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-71f2d8ee-a77c-4308-bb70-63c72da7a782 req-16546488-6fff-49fc-b7f6-85ee7b7a5ae4 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Received event network-vif-deleted-116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:02 user nova-compute[80928]: INFO nova.compute.manager [req-71f2d8ee-a77c-4308-bb70-63c72da7a782 req-16546488-6fff-49fc-b7f6-85ee7b7a5ae4 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Neutron deleted interface 116f20fc-ab87-4a6a-983d-57d79b42b0a1; detaching it from the instance and deleting it from the info cache
Nov 16 05:31:02 user nova-compute[80928]: DEBUG nova.network.neutron [req-71f2d8ee-a77c-4308-bb70-63c72da7a782 req-16546488-6fff-49fc-b7f6-85ee7b7a5ae4 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:02 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Took 0.62 seconds to deallocate network for instance.
Nov 16 05:31:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-71f2d8ee-a77c-4308-bb70-63c72da7a782 req-16546488-6fff-49fc-b7f6-85ee7b7a5ae4 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Detach interface failed, port_id=116f20fc-ab87-4a6a-983d-57d79b42b0a1, reason: Instance 983eadda-f7cc-410c-91b5-62082cefe9ca could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:31:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23131313930653931', 'path': '/dev/sdf'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131313930653931', 'path': '/dev/sdf'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:31:03 user nova-compute[80928]: DEBUG nova.objects.instance [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'flavor' on Instance uuid 5687e588-1245-42a9-b2d8-306c3c6bf8c5 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:31:03 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:03 user nova-compute[80928]:   <source dev="/dev/sdf"/>
Nov 16 05:31:03 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:31:03 user nova-compute[80928]:   <serial>a647a8dd-46fe-40a4-9628-79364cacf96a</serial>
Nov 16 05:31:03 user nova-compute[80928]: </disk>
Nov 16 05:31:03 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:31:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-5e51ec12-bfc3-4bcb-a88e-2b71f3dbccf2 req-2fabd34b-1d02-4abe-9041-4bc564b2ff24 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Received event network-vif-plugged-116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5e51ec12-bfc3-4bcb-a88e-2b71f3dbccf2 req-2fabd34b-1d02-4abe-9041-4bc564b2ff24 service nova] Acquiring lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5e51ec12-bfc3-4bcb-a88e-2b71f3dbccf2 req-2fabd34b-1d02-4abe-9041-4bc564b2ff24 service nova] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5e51ec12-bfc3-4bcb-a88e-2b71f3dbccf2 req-2fabd34b-1d02-4abe-9041-4bc564b2ff24 service nova] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-5e51ec12-bfc3-4bcb-a88e-2b71f3dbccf2 req-2fabd34b-1d02-4abe-9041-4bc564b2ff24 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] No waiting events found dispatching network-vif-plugged-116f20fc-ab87-4a6a-983d-57d79b42b0a1 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:03 user nova-compute[80928]: WARNING nova.compute.manager [req-5e51ec12-bfc3-4bcb-a88e-2b71f3dbccf2 req-2fabd34b-1d02-4abe-9041-4bc564b2ff24 service nova] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Received unexpected event network-vif-plugged-116f20fc-ab87-4a6a-983d-57d79b42b0a1 for instance with vm_state active and task_state deleting.
Nov 16 05:31:03 user nova-compute[80928]: INFO nova.compute.manager [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] [instance: 983eadda-f7cc-410c-91b5-62082cefe9ca] Took 0.80 seconds to detach 1 volumes for instance.
Nov 16 05:31:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No VIF found with MAC fa:16:3e:41:e0:38, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:31:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aed2120d-0495-415e-b69a-0a0e73e05f4c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.979s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:04 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:31:04 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:31:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.629s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:04 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Deleted allocations for instance 983eadda-f7cc-410c-91b5-62082cefe9ca
Nov 16 05:31:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9f22cbdc-8d94-413e-9d87-dbc29e95f151 tempest-DeleteServersTestJSON-1669441791 tempest-DeleteServersTestJSON-1669441791-project-member] Lock "983eadda-f7cc-410c-91b5-62082cefe9ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.299s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "fcdb0315-072c-431b-9583-400e51041f49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "fcdb0315-072c-431b-9583-400e51041f49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:31:07 user nova-compute[80928]: INFO nova.compute.claims [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Claim successful on node user
Nov 16 05:31:07 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:31:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:31:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG nova.policy [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '952a7ea7e63649259b0b1e0df40c97d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f585dcb9e6cb432a9b04526ebc30e9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:31:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Creating image(s)
Nov 16 05:31:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "/opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "/opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.168s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk 1073741824" returned: 0 in 0.063s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Successfully created port: ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Cannot resize image /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Ensure instance console log exists: /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-0980fd2d-a77b-4f63-a5f0-0f2f1a4a5437 req-de78866f-d114-4435-b617-954c93db5bb9 service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Received event network-changed-f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-0980fd2d-a77b-4f63-a5f0-0f2f1a4a5437 req-de78866f-d114-4435-b617-954c93db5bb9 service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Refreshing instance network info cache due to event network-changed-f4e24095-a59c-4e7a-8339-8afb6230dde5. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0980fd2d-a77b-4f63-a5f0-0f2f1a4a5437 req-de78866f-d114-4435-b617-954c93db5bb9 service nova] Acquiring lock "refresh_cache-ff21d416-8ff1-49b5-9f2b-e55df3444e8f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0980fd2d-a77b-4f63-a5f0-0f2f1a4a5437 req-de78866f-d114-4435-b617-954c93db5bb9 service nova] Acquired lock "refresh_cache-ff21d416-8ff1-49b5-9f2b-e55df3444e8f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-0980fd2d-a77b-4f63-a5f0-0f2f1a4a5437 req-de78866f-d114-4435-b617-954c93db5bb9 service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Refreshing network info cache for port f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Successfully updated port: ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "refresh_cache-fcdb0315-072c-431b-9583-400e51041f49" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquired lock "refresh_cache-fcdb0315-072c-431b-9583-400e51041f49" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-1c4c1613-905e-41cf-8fbe-7f344e9ca2c4 req-0c083202-3a0c-4851-bbbd-5ba7b4501476 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Received event network-changed-ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-1c4c1613-905e-41cf-8fbe-7f344e9ca2c4 req-0c083202-3a0c-4851-bbbd-5ba7b4501476 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Refreshing instance network info cache due to event network-changed-ca6d6935-11fe-45a3-913f-eba95bb46979. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1c4c1613-905e-41cf-8fbe-7f344e9ca2c4 req-0c083202-3a0c-4851-bbbd-5ba7b4501476 service nova] Acquiring lock "refresh_cache-fcdb0315-072c-431b-9583-400e51041f49" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Updating instance_info_cache with network_info: [{"id": "ca6d6935-11fe-45a3-913f-eba95bb46979", "address": "fa:16:3e:74:a3:c2", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6d6935-11", "ovs_interfaceid": "ca6d6935-11fe-45a3-913f-eba95bb46979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Releasing lock "refresh_cache-fcdb0315-072c-431b-9583-400e51041f49" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Instance network_info: |[{"id": "ca6d6935-11fe-45a3-913f-eba95bb46979", "address": "fa:16:3e:74:a3:c2", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6d6935-11", "ovs_interfaceid": "ca6d6935-11fe-45a3-913f-eba95bb46979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1c4c1613-905e-41cf-8fbe-7f344e9ca2c4 req-0c083202-3a0c-4851-bbbd-5ba7b4501476 service nova] Acquired lock "refresh_cache-fcdb0315-072c-431b-9583-400e51041f49" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-1c4c1613-905e-41cf-8fbe-7f344e9ca2c4 req-0c083202-3a0c-4851-bbbd-5ba7b4501476 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Refreshing network info cache for port ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Start _get_guest_xml network_info=[{"id": "ca6d6935-11fe-45a3-913f-eba95bb46979", "address": "fa:16:3e:74:a3:c2", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6d6935-11", "ovs_interfaceid": "ca6d6935-11fe-45a3-913f-eba95bb46979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-0980fd2d-a77b-4f63-a5f0-0f2f1a4a5437 req-de78866f-d114-4435-b617-954c93db5bb9 service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Updated VIF entry in instance network info cache for port f4e24095-a59c-4e7a-8339-8afb6230dde5. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-0980fd2d-a77b-4f63-a5f0-0f2f1a4a5437 req-de78866f-d114-4435-b617-954c93db5bb9 service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Updating instance_info_cache with network_info: [{"id": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "address": "fa:16:3e:c0:a9:eb", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e24095-a5", "ovs_interfaceid": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:09 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:31:09 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:31:09 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-711591726',display_name='tempest-AttachVolumeNegativeTest-server-711591726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-711591726',id=13,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0dFzAu5lolz9NMDNDSzjrqXiKlYM5FlBqmuUAqTzgtGswx4bUaWbOFHRJFd0LyBDpitYUAAvyZto/7+aSJtdPzTxIrpp9izbGRmpmVK1roVvOgRs1sk5ZamvAUFk+lfg==',key_name='tempest-keypair-595545743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f585dcb9e6cb432a9b04526ebc30e9d8',ramdisk_id='',reservation_id='r-l0h4se5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-155531213',owner_user_name='tempest-AttachVolumeNegativeTest-155531213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:31:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952a7ea7e63649259b0b1e0df40c97d0',uuid=fcdb0315-072c-431b-9583-400e51041f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca6d6935-11fe-45a3-913f-eba95bb46979", "address": "fa:16:3e:74:a3:c2", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6d6935-11", "ovs_interfaceid": "ca6d6935-11fe-45a3-913f-eba95bb46979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converting VIF {"id": "ca6d6935-11fe-45a3-913f-eba95bb46979", "address": "fa:16:3e:74:a3:c2", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6d6935-11", "ovs_interfaceid": "ca6d6935-11fe-45a3-913f-eba95bb46979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a3:c2,bridge_name='br-int',has_traffic_filtering=True,id=ca6d6935-11fe-45a3-913f-eba95bb46979,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6d6935-11') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'pci_devices' on Instance uuid fcdb0315-072c-431b-9583-400e51041f49 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0980fd2d-a77b-4f63-a5f0-0f2f1a4a5437 req-de78866f-d114-4435-b617-954c93db5bb9 service nova] Releasing lock "refresh_cache-ff21d416-8ff1-49b5-9f2b-e55df3444e8f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:31:10 user nova-compute[80928]:   <uuid>fcdb0315-072c-431b-9583-400e51041f49</uuid>
Nov 16 05:31:10 user nova-compute[80928]:   <name>instance-0000000d</name>
Nov 16 05:31:10 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:31:10 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:31:10 user nova-compute[80928]:   <metadata>
Nov 16 05:31:10 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:31:10 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:31:10 user nova-compute[80928]:       <nova:name>tempest-AttachVolumeNegativeTest-server-711591726</nova:name>
Nov 16 05:31:10 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:31:09</nova:creationTime>
Nov 16 05:31:10 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:31:10 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:31:10 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:31:10 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:31:10 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:31:10 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:31:10 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:31:10 user nova-compute[80928]:       <nova:owner>
Nov 16 05:31:10 user nova-compute[80928]:         <nova:user uuid="952a7ea7e63649259b0b1e0df40c97d0">tempest-AttachVolumeNegativeTest-155531213-project-member</nova:user>
Nov 16 05:31:10 user nova-compute[80928]:         <nova:project uuid="f585dcb9e6cb432a9b04526ebc30e9d8">tempest-AttachVolumeNegativeTest-155531213</nova:project>
Nov 16 05:31:10 user nova-compute[80928]:       </nova:owner>
Nov 16 05:31:10 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:31:10 user nova-compute[80928]:       <nova:ports>
Nov 16 05:31:10 user nova-compute[80928]:         <nova:port uuid="ca6d6935-11fe-45a3-913f-eba95bb46979">
Nov 16 05:31:10 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 05:31:10 user nova-compute[80928]:         </nova:port>
Nov 16 05:31:10 user nova-compute[80928]:       </nova:ports>
Nov 16 05:31:10 user nova-compute[80928]:     </nova:instance>
Nov 16 05:31:10 user nova-compute[80928]:   </metadata>
Nov 16 05:31:10 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:31:10 user nova-compute[80928]:     <system>
Nov 16 05:31:10 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:31:10 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:31:10 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:31:10 user nova-compute[80928]:       <entry name="serial">fcdb0315-072c-431b-9583-400e51041f49</entry>
Nov 16 05:31:10 user nova-compute[80928]:       <entry name="uuid">fcdb0315-072c-431b-9583-400e51041f49</entry>
Nov 16 05:31:10 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:31:10 user nova-compute[80928]:     </system>
Nov 16 05:31:10 user nova-compute[80928]:   </sysinfo>
Nov 16 05:31:10 user nova-compute[80928]:   <os>
Nov 16 05:31:10 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:31:10 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:31:10 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:31:10 user nova-compute[80928]:   </os>
Nov 16 05:31:10 user nova-compute[80928]:   <features>
Nov 16 05:31:10 user nova-compute[80928]:     <acpi/>
Nov 16 05:31:10 user nova-compute[80928]:     <apic/>
Nov 16 05:31:10 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:31:10 user nova-compute[80928]:   </features>
Nov 16 05:31:10 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:31:10 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:31:10 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:31:10 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:31:10 user nova-compute[80928]:   </clock>
Nov 16 05:31:10 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:31:10 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:31:10 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:31:10 user nova-compute[80928]:   </cpu>
Nov 16 05:31:10 user nova-compute[80928]:   <devices>
Nov 16 05:31:10 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:31:10 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:31:10 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk"/>
Nov 16 05:31:10 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:31:10 user nova-compute[80928]:     </disk>
Nov 16 05:31:10 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:31:10 user nova-compute[80928]:       <mac address="fa:16:3e:74:a3:c2"/>
Nov 16 05:31:10 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:31:10 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:31:10 user nova-compute[80928]:       <target dev="tapca6d6935-11"/>
Nov 16 05:31:10 user nova-compute[80928]:     </interface>
Nov 16 05:31:10 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:31:10 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/console.log" append="off"/>
Nov 16 05:31:10 user nova-compute[80928]:     </serial>
Nov 16 05:31:10 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:31:10 user nova-compute[80928]:     <video>
Nov 16 05:31:10 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:31:10 user nova-compute[80928]:     </video>
Nov 16 05:31:10 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:31:10 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:31:10 user nova-compute[80928]:     </rng>
Nov 16 05:31:10 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:31:10 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:31:10 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:31:10 user nova-compute[80928]:     </memballoon>
Nov 16 05:31:10 user nova-compute[80928]:   </devices>
Nov 16 05:31:10 user nova-compute[80928]: </domain>
Nov 16 05:31:10 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-711591726',display_name='tempest-AttachVolumeNegativeTest-server-711591726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-711591726',id=13,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0dFzAu5lolz9NMDNDSzjrqXiKlYM5FlBqmuUAqTzgtGswx4bUaWbOFHRJFd0LyBDpitYUAAvyZto/7+aSJtdPzTxIrpp9izbGRmpmVK1roVvOgRs1sk5ZamvAUFk+lfg==',key_name='tempest-keypair-595545743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f585dcb9e6cb432a9b04526ebc30e9d8',ramdisk_id='',reservation_id='r-l0h4se5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-155531213',owner_user_name='tempest-AttachVolumeNegativeTest-155531213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:31:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952a7ea7e63649259b0b1e0df40c97d0',uuid=fcdb0315-072c-431b-9583-400e51041f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca6d6935-11fe-45a3-913f-eba95bb46979", "address": "fa:16:3e:74:a3:c2", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6d6935-11", "ovs_interfaceid": "ca6d6935-11fe-45a3-913f-eba95bb46979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converting VIF {"id": "ca6d6935-11fe-45a3-913f-eba95bb46979", "address": "fa:16:3e:74:a3:c2", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6d6935-11", "ovs_interfaceid": "ca6d6935-11fe-45a3-913f-eba95bb46979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a3:c2,bridge_name='br-int',has_traffic_filtering=True,id=ca6d6935-11fe-45a3-913f-eba95bb46979,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6d6935-11') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG os_vif [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a3:c2,bridge_name='br-int',has_traffic_filtering=True,id=ca6d6935-11fe-45a3-913f-eba95bb46979,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6d6935-11') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9e6a3be-317d-543e-85a4-023a966fe1f5', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca6d6935-11, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca6d6935-11, col_values=(('qos', UUID('134ea37f-9450-42d4-9ae2-793777bdc083')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca6d6935-11, col_values=(('external_ids', {'iface-id': 'ca6d6935-11fe-45a3-913f-eba95bb46979', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:a3:c2', 'vm-uuid': 'fcdb0315-072c-431b-9583-400e51041f49'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:10 user nova-compute[80928]: INFO os_vif [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a3:c2,bridge_name='br-int',has_traffic_filtering=True,id=ca6d6935-11fe-45a3-913f-eba95bb46979,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6d6935-11')
Nov 16 05:31:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No VIF found with MAC fa:16:3e:74:a3:c2, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG nova.network.neutron [req-1c4c1613-905e-41cf-8fbe-7f344e9ca2c4 req-0c083202-3a0c-4851-bbbd-5ba7b4501476 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Updated VIF entry in instance network info cache for port ca6d6935-11fe-45a3-913f-eba95bb46979. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG nova.network.neutron [req-1c4c1613-905e-41cf-8fbe-7f344e9ca2c4 req-0c083202-3a0c-4851-bbbd-5ba7b4501476 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Updating instance_info_cache with network_info: [{"id": "ca6d6935-11fe-45a3-913f-eba95bb46979", "address": "fa:16:3e:74:a3:c2", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6d6935-11", "ovs_interfaceid": "ca6d6935-11fe-45a3-913f-eba95bb46979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1c4c1613-905e-41cf-8fbe-7f344e9ca2c4 req-0c083202-3a0c-4851-bbbd-5ba7b4501476 service nova] Releasing lock "refresh_cache-fcdb0315-072c-431b-9583-400e51041f49" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:31:11 user nova-compute[80928]: DEBUG nova.compute.manager [req-9fe28dba-a30a-4c61-be34-a4511c6028c0 req-3a7ea84c-ed6c-40b9-89ad-3d7fb11b9a29 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Received event network-changed-7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:11 user nova-compute[80928]: DEBUG nova.compute.manager [req-9fe28dba-a30a-4c61-be34-a4511c6028c0 req-3a7ea84c-ed6c-40b9-89ad-3d7fb11b9a29 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Refreshing instance network info cache due to event network-changed-7d457e99-6d46-412d-95d2-6feddbd6fc9e. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:31:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9fe28dba-a30a-4c61-be34-a4511c6028c0 req-3a7ea84c-ed6c-40b9-89ad-3d7fb11b9a29 service nova] Acquiring lock "refresh_cache-556f0ce2-2601-4bbe-9b0d-d70061cdc955" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:31:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9fe28dba-a30a-4c61-be34-a4511c6028c0 req-3a7ea84c-ed6c-40b9-89ad-3d7fb11b9a29 service nova] Acquired lock "refresh_cache-556f0ce2-2601-4bbe-9b0d-d70061cdc955" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:31:11 user nova-compute[80928]: DEBUG nova.network.neutron [req-9fe28dba-a30a-4c61-be34-a4511c6028c0 req-3a7ea84c-ed6c-40b9-89ad-3d7fb11b9a29 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Refreshing network info cache for port 7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:31:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG nova.compute.manager [req-57f9c994-5a2c-4a2a-93d9-1d5758f5eee6 req-819ab571-9973-4578-91e7-1a10fe5621f6 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Received event network-vif-plugged-ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-57f9c994-5a2c-4a2a-93d9-1d5758f5eee6 req-819ab571-9973-4578-91e7-1a10fe5621f6 service nova] Acquiring lock "fcdb0315-072c-431b-9583-400e51041f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-57f9c994-5a2c-4a2a-93d9-1d5758f5eee6 req-819ab571-9973-4578-91e7-1a10fe5621f6 service nova] Lock "fcdb0315-072c-431b-9583-400e51041f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-57f9c994-5a2c-4a2a-93d9-1d5758f5eee6 req-819ab571-9973-4578-91e7-1a10fe5621f6 service nova] Lock "fcdb0315-072c-431b-9583-400e51041f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG nova.compute.manager [req-57f9c994-5a2c-4a2a-93d9-1d5758f5eee6 req-819ab571-9973-4578-91e7-1a10fe5621f6 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] No waiting events found dispatching network-vif-plugged-ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:12 user nova-compute[80928]: WARNING nova.compute.manager [req-57f9c994-5a2c-4a2a-93d9-1d5758f5eee6 req-819ab571-9973-4578-91e7-1a10fe5621f6 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Received unexpected event network-vif-plugged-ca6d6935-11fe-45a3-913f-eba95bb46979 for instance with vm_state building and task_state spawning.
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lazy-loading 'flavor' on Instance uuid ff21d416-8ff1-49b5-9f2b-e55df3444e8f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG nova.network.neutron [req-9fe28dba-a30a-4c61-be34-a4511c6028c0 req-3a7ea84c-ed6c-40b9-89ad-3d7fb11b9a29 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Updated VIF entry in instance network info cache for port 7d457e99-6d46-412d-95d2-6feddbd6fc9e. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG nova.network.neutron [req-9fe28dba-a30a-4c61-be34-a4511c6028c0 req-3a7ea84c-ed6c-40b9-89ad-3d7fb11b9a29 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Updating instance_info_cache with network_info: [{"id": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "address": "fa:16:3e:c3:ae:ba", "network": {"id": "bd23aab1-aedf-4fc6-963c-3dd404bcdb8d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-237317009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c8035128c48e9baa453b52c601246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d457e99-6d", "ovs_interfaceid": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9fe28dba-a30a-4c61-be34-a4511c6028c0 req-3a7ea84c-ed6c-40b9-89ad-3d7fb11b9a29 service nova] Releasing lock "refresh_cache-556f0ce2-2601-4bbe-9b0d-d70061cdc955" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:12 user nova-compute[80928]: INFO nova.compute.manager [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Attaching volume 6d57ef23-4788-4137-a0c2-e5ab73373efc to /dev/vdb
Nov 16 05:31:12 user nova-compute[80928]: DEBUG os_brick.utils [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24eee01-af69-454b-acac-d02f92c0203c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7181ba1-4f6e-49bd-812e-2882636d4bbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6913a1f-2d0f-4109-8e23-21059975f82a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1503c2f6-84dc-430c-8c6c-ed8adba7e302]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:31:12 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b592fd67-4b60-4e61-85e8-2ee1f8e828a2]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG os_brick.utils [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Updating existing volume attachment record: 8f9b7937-43de-4bb6-a834-c32d87e15e7c {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG nova.objects.instance [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lazy-loading 'flavor' on Instance uuid 556f0ce2-2601-4bbe-9b0d-d70061cdc955 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:13 user nova-compute[80928]: INFO nova.compute.manager [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Attaching volume 156a5a52-0fbc-4251-a49b-67579facb176 to /dev/sdc
Nov 16 05:31:13 user nova-compute[80928]: DEBUG os_brick.utils [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a0bcde-caae-4828-a479-dbe0212b76fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f67d5a5-8bcc-4359-af08-2e55e95c377b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[37296bc4-96cd-488c-96bb-51db68b50691]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca65d5a5-42ce-41b4-98bb-f69f41e48d20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:31:13 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:31:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c418db0a-2265-43db-870a-3e613c84a8f6]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG os_brick.utils [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Updating existing volume attachment record: 40ec84dd-563b-4f0e-8746-63a4159c981e {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:31:13 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: fcdb0315-072c-431b-9583-400e51041f49] Instance spawned successfully.
Nov 16 05:31:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:31:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:31:13 user nova-compute[80928]: INFO nova.compute.manager [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 16 05:31:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:31:14 user nova-compute[80928]: INFO nova.compute.manager [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Took 6.77 seconds to build instance.
Nov 16 05:31:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7db06c06-507c-4783-ade3-8efef11970ea tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "fcdb0315-072c-431b-9583-400e51041f49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.873s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-a0a09b1b-e7fb-4abd-b7ea-922df35c0cb9 req-2a6b9ab0-ca34-42cd-812c-e164e893bfc5 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Received event network-vif-plugged-ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a0a09b1b-e7fb-4abd-b7ea-922df35c0cb9 req-2a6b9ab0-ca34-42cd-812c-e164e893bfc5 service nova] Acquiring lock "fcdb0315-072c-431b-9583-400e51041f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a0a09b1b-e7fb-4abd-b7ea-922df35c0cb9 req-2a6b9ab0-ca34-42cd-812c-e164e893bfc5 service nova] Lock "fcdb0315-072c-431b-9583-400e51041f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a0a09b1b-e7fb-4abd-b7ea-922df35c0cb9 req-2a6b9ab0-ca34-42cd-812c-e164e893bfc5 service nova] Lock "fcdb0315-072c-431b-9583-400e51041f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-a0a09b1b-e7fb-4abd-b7ea-922df35c0cb9 req-2a6b9ab0-ca34-42cd-812c-e164e893bfc5 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] No waiting events found dispatching network-vif-plugged-ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:14 user nova-compute[80928]: WARNING nova.compute.manager [req-a0a09b1b-e7fb-4abd-b7ea-922df35c0cb9 req-2a6b9ab0-ca34-42cd-812c-e164e893bfc5 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Received unexpected event network-vif-plugged-ca6d6935-11fe-45a3-913f-eba95bb46979 for instance with vm_state active and task_state None.
Nov 16 05:31:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-fa6f2816-4058-4221-ba2f-e5b8daa49899 req-61178723-2bd8-4669-8d3f-f2821e985947 service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Received event network-changed-cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-fa6f2816-4058-4221-ba2f-e5b8daa49899 req-61178723-2bd8-4669-8d3f-f2821e985947 service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Refreshing instance network info cache due to event network-changed-cf2f55ef-66cf-4992-97ee-404155885646. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fa6f2816-4058-4221-ba2f-e5b8daa49899 req-61178723-2bd8-4669-8d3f-f2821e985947 service nova] Acquiring lock "refresh_cache-e8a6c1a3-ddb9-4a38-86a5-420afe793380" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fa6f2816-4058-4221-ba2f-e5b8daa49899 req-61178723-2bd8-4669-8d3f-f2821e985947 service nova] Acquired lock "refresh_cache-e8a6c1a3-ddb9-4a38-86a5-420afe793380" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG nova.network.neutron [req-fa6f2816-4058-4221-ba2f-e5b8daa49899 req-61178723-2bd8-4669-8d3f-f2821e985947 service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Refreshing network info cache for port cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG nova.objects.instance [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lazy-loading 'flavor' on Instance uuid e8a6c1a3-ddb9-4a38-86a5-420afe793380 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG nova.network.neutron [req-fa6f2816-4058-4221-ba2f-e5b8daa49899 req-61178723-2bd8-4669-8d3f-f2821e985947 service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Updated VIF entry in instance network info cache for port cf2f55ef-66cf-4992-97ee-404155885646. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG nova.network.neutron [req-fa6f2816-4058-4221-ba2f-e5b8daa49899 req-61178723-2bd8-4669-8d3f-f2821e985947 service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Updating instance_info_cache with network_info: [{"id": "cf2f55ef-66cf-4992-97ee-404155885646", "address": "fa:16:3e:e1:0a:71", "network": {"id": "ddaebf50-a3a9-46ab-858a-95a4ecd44b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202869077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6eeae1a4a6d44f44a30ace81f6b2177d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2f55ef-66", "ovs_interfaceid": "cf2f55ef-66cf-4992-97ee-404155885646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fa6f2816-4058-4221-ba2f-e5b8daa49899 req-61178723-2bd8-4669-8d3f-f2821e985947 service nova] Releasing lock "refresh_cache-e8a6c1a3-ddb9-4a38-86a5-420afe793380" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:16 user nova-compute[80928]: INFO nova.compute.manager [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Attaching volume f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 to /dev/vdb
Nov 16 05:31:17 user nova-compute[80928]: DEBUG os_brick.utils [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[049d2491-f81a-42e8-a6c1-d8fde06f2ed0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabfaedd-18ee-4e37-8ca7-b1745471604b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[45577734-4350-4c8a-885c-1482651659a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[066d35c2-bf2a-43b4-a217-037c46d3eed2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:31:17 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:31:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[003798d1-1771-480a-8e3b-daae78f36bee]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG os_brick.utils [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:17 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Updating existing volume attachment record: 1dbfc162-ee1f-4ec8-8c82-184c9284fc3c {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:31:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:31:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDkIFomr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:18 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:18 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:18 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:31:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87ac388-7018-4358-bcef-c7e3f23a8b58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:31:19 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a5ed01-9aea-4d0e-ae6e-ee43c86543c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176] added
Nov 16 05:31:19 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0b7991-a31c-428b-8ffa-faeeac4e4a5d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f728944-b1a4-4867-9b5e-86a1ef9a10f1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aDkIFomr {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aDkIFomr" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5055ae1c-db77-4e3f-aa62-313864b797f4]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aDkIFomr'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d68018-2200-47ea-a785-86ffbf67648a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3088035-3f71-430f-8edd-573770d1b780]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:19 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:19 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[560d3282-44fa-4549-96da-4923801a48d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176, portal: 172.16.0.220,3260]
Nov 16 05:31:19 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:19 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c78aae5-a4d8-41ee-ad26-4509831ffb2b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b47e64-8f1d-4e74-9574-98becaa50ee9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:19 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:19 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5860fd7-e2d4-4a49-8d75-c2831eb04c76]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:31:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDkIFomr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:31:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26633363463316461', 'path': '/dev/sdg'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633363463316461', 'path': '/dev/sdg'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:31:20 user nova-compute[80928]: DEBUG nova.objects.instance [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lazy-loading 'flavor' on Instance uuid 556f0ce2-2601-4bbe-9b0d-d70061cdc955 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:31:20 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:20 user nova-compute[80928]:   <source dev="/dev/sdg"/>
Nov 16 05:31:20 user nova-compute[80928]:   <target dev="sdc" bus="scsi"/>
Nov 16 05:31:20 user nova-compute[80928]:   <serial>156a5a52-0fbc-4251-a49b-67579facb176</serial>
Nov 16 05:31:20 user nova-compute[80928]:   <address type="drive" controller="0" unit="2"/>
Nov 16 05:31:20 user nova-compute[80928]: </disk>
Nov 16 05:31:20 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:31:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] No BDM found with device name sda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] No BDM found with device name sdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] No BDM found with device name sdc, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] No VIF found with MAC fa:16:3e:c3:ae:ba, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:31:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-79fa7db4-4d9d-4cbf-ad11-82e608279f2f tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.028s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:21 user nova-compute[80928]: INFO nova.compute.manager [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Detaching volume 156a5a52-0fbc-4251-a49b-67579facb176
Nov 16 05:31:21 user nova-compute[80928]: INFO nova.virt.block_device [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Attempting to driver detach volume 156a5a52-0fbc-4251-a49b-67579facb176 from mountpoint /dev/sdc
Nov 16 05:31:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Attempting to detach device sdc from instance 556f0ce2-2601-4bbe-9b0d-d70061cdc955 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:31:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:31:21 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:21 user nova-compute[80928]:   <source dev="/dev/sdg"/>
Nov 16 05:31:21 user nova-compute[80928]:   <target dev="sdc" bus="scsi"/>
Nov 16 05:31:21 user nova-compute[80928]:   <serial>156a5a52-0fbc-4251-a49b-67579facb176</serial>
Nov 16 05:31:21 user nova-compute[80928]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 05:31:21 user nova-compute[80928]: </disk>
Nov 16 05:31:21 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:31:21 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Successfully detached device sdc from instance 556f0ce2-2601-4bbe-9b0d-d70061cdc955 from the persistent domain config.
Nov 16 05:31:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 556f0ce2-2601-4bbe-9b0d-d70061cdc955 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:31:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:31:21 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:21 user nova-compute[80928]:   <source dev="/dev/sdg"/>
Nov 16 05:31:21 user nova-compute[80928]:   <target dev="sdc" bus="scsi"/>
Nov 16 05:31:21 user nova-compute[80928]:   <serial>156a5a52-0fbc-4251-a49b-67579facb176</serial>
Nov 16 05:31:21 user nova-compute[80928]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 05:31:21 user nova-compute[80928]: </disk>
Nov 16 05:31:21 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:31:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 556f0ce2-2601-4bbe-9b0d-d70061cdc955 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrSBmFXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:23 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:23 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:23 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0563338e-b6f2-4a1f-8869-c01224106943]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:31:23 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d102909-a6c9-477b-b039-caa5f8604933]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc] added
Nov 16 05:31:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e614f-1230-4490-87b8-9cc27c9cdcba]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fed8ba-82d3-457c-bca5-5a260d1631dd]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrSBmFXx {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luPirdfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:23 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrSBmFXx" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1807db64-81fb-4f31-9a36-61dbe2e214a7]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vrSBmFXx'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[88880d6c-ef66-4687-8680-fcb516317761]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[702a73d9-bfd9-49f8-930e-0cb229b0c7f1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0385278-7670-438e-9f21-3f408153194e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc, portal: 172.16.0.220,3260]
Nov 16 05:31:23 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb88702-d165-4318-9f18-034c706af911]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dfc511-1094-41f8-b0a3-6cfb4954d802]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:23 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec67a3c0-9669-40dd-83d0-e294015ae6a0]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:23 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrSBmFXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26435376131626164', 'path': '/dev/sdh'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435376131626164', 'path': '/dev/sdh'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.249s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:24 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:24 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lazy-loading 'flavor' on Instance uuid ff21d416-8ff1-49b5-9f2b-e55df3444e8f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[425c4f16-d7b5-4291-a348-b3eb5328698c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:31:24 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:31:24 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:24 user nova-compute[80928]:   <source dev="/dev/sdh"/>
Nov 16 05:31:24 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:31:24 user nova-compute[80928]:   <serial>6d57ef23-4788-4137-a0c2-e5ab73373efc</serial>
Nov 16 05:31:24 user nova-compute[80928]: </disk>
Nov 16 05:31:24 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb35a728-5c49-4c33-81e3-811c003ffd1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872] added
Nov 16 05:31:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ab7963-d362-458f-849d-049fe8f00be6]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.074s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc2088a-1ca4-4a20-9fe5-16b675803471]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v luPirdfI {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v luPirdfI" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d042faa5-9211-4fbb-ab8b-3d59317befae]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'luPirdfI'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea99a485-dccd-464a-a0de-82facbf093ae]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[734178ca-27f7-44af-ba66-40616b0490e7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[db480fde-4f58-4cce-ad91-cd7ff03be759]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260]
Nov 16 05:31:24 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[79921f64-7791-415a-bd56-21c90c7137dd]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a2c2f0-abd5-4d4e-9328-601f10322132]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:24 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceba3de-1f5e-4a9d-ae0a-dd2738349d77]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:31:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luPirdfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:31:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] No VIF found with MAC fa:16:3e:c0:a9:eb, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:31:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8b4f2d4-5609-41c2-93ec-b63df478b89d tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.779s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.501s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] <== connect_volume: return (2750ms) {'type': 'block', 'scsi_wwn': '26563643834386537', 'path': '/dev/sdi'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563643834386537', 'path': '/dev/sdi'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:31:25 user nova-compute[80928]: DEBUG nova.objects.instance [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lazy-loading 'flavor' on Instance uuid e8a6c1a3-ddb9-4a38-86a5-420afe793380 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:31:25 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:25 user nova-compute[80928]:   <source dev="/dev/sdi"/>
Nov 16 05:31:25 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:31:25 user nova-compute[80928]:   <serial>f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872</serial>
Nov 16 05:31:25 user nova-compute[80928]: </disk>
Nov 16 05:31:25 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:31:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:26 user nova-compute[80928]: INFO nova.compute.manager [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Detaching volume 6d57ef23-4788-4137-a0c2-e5ab73373efc
Nov 16 05:31:26 user nova-compute[80928]: INFO nova.virt.block_device [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Attempting to driver detach volume 6d57ef23-4788-4137-a0c2-e5ab73373efc from mountpoint /dev/vdb
Nov 16 05:31:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Attempting to detach device vdb from instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:31:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:31:26 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:26 user nova-compute[80928]:   <source dev="/dev/sdh"/>
Nov 16 05:31:26 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:31:26 user nova-compute[80928]:   <serial>6d57ef23-4788-4137-a0c2-e5ab73373efc</serial>
Nov 16 05:31:26 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:31:26 user nova-compute[80928]: </disk>
Nov 16 05:31:26 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:31:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Successfully detached device vdb from instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f from the persistent domain config.
Nov 16 05:31:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:31:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:31:26 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:26 user nova-compute[80928]:   <source dev="/dev/sdh"/>
Nov 16 05:31:26 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:31:26 user nova-compute[80928]:   <serial>6d57ef23-4788-4137-a0c2-e5ab73373efc</serial>
Nov 16 05:31:26 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:31:26 user nova-compute[80928]: </disk>
Nov 16 05:31:26 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:31:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] No VIF found with MAC fa:16:3e:e1:0a:71, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:31:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a28e2f5c-515a-42ef-a3ef-2ffbd69654e4 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.635s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Acquiring lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG os_brick.utils [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb05fb8f-f822-422e-8896-10529f977ad1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[264123f6-cb14-4ced-8f04-afe37b746ebc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c68fbaa-8db4-4721-960e-554d902ad4fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fd56ce-fb23-4ba8-8141-65423f0ddfdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:31:27 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:31:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ab59c3-a135-49a9-ac73-af457b8fad5b]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:31:27 user nova-compute[80928]: DEBUG os_brick.utils [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:27 user nova-compute[80928]: INFO nova.compute.manager [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Swapping volume f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 for d6636ad4-cc6f-4e99-b01e-c2d6480e192a
Nov 16 05:31:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-42e4c4f7-64e7-49aa-8c3e-2f38ca3431cf req-d9385dd8-0793-4a7a-9ac7-39950c0e3b29 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Received event network-changed-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-42e4c4f7-64e7-49aa-8c3e-2f38ca3431cf req-d9385dd8-0793-4a7a-9ac7-39950c0e3b29 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Refreshing instance network info cache due to event network-changed-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:31:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-42e4c4f7-64e7-49aa-8c3e-2f38ca3431cf req-d9385dd8-0793-4a7a-9ac7-39950c0e3b29 service nova] Acquiring lock "refresh_cache-f3367d72-f511-4285-a77b-b26932bf7490" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:31:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-42e4c4f7-64e7-49aa-8c3e-2f38ca3431cf req-d9385dd8-0793-4a7a-9ac7-39950c0e3b29 service nova] Acquired lock "refresh_cache-f3367d72-f511-4285-a77b-b26932bf7490" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:31:30 user nova-compute[80928]: DEBUG nova.network.neutron [req-42e4c4f7-64e7-49aa-8c3e-2f38ca3431cf req-d9385dd8-0793-4a7a-9ac7-39950c0e3b29 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Refreshing network info cache for port f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:31:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Acquiring lock "f3367d72-f511-4285-a77b-b26932bf7490" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lock "f3367d72-f511-4285-a77b-b26932bf7490" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:30 user nova-compute[80928]: DEBUG nova.objects.instance [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lazy-loading 'flavor' on Instance uuid f3367d72-f511-4285-a77b-b26932bf7490 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lock "f3367d72-f511-4285-a77b-b26932bf7490" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Acquiring lock "f3367d72-f511-4285-a77b-b26932bf7490" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lock "f3367d72-f511-4285-a77b-b26932bf7490" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:31 user nova-compute[80928]: INFO nova.compute.manager [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Attaching volume 1a9d880e-0cd6-4969-bd08-8cb903146403 to /dev/vdb
Nov 16 05:31:31 user nova-compute[80928]: DEBUG nova.network.neutron [req-42e4c4f7-64e7-49aa-8c3e-2f38ca3431cf req-d9385dd8-0793-4a7a-9ac7-39950c0e3b29 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Updated VIF entry in instance network info cache for port f99a8c0e-612a-49fa-ab8b-4435ed59c9f5. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG nova.network.neutron [req-42e4c4f7-64e7-49aa-8c3e-2f38ca3431cf req-d9385dd8-0793-4a7a-9ac7-39950c0e3b29 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Updating instance_info_cache with network_info: [{"id": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "address": "fa:16:3e:4f:e8:78", "network": {"id": "0ba3296e-39e0-4dcc-8238-d1a8970ac672", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508086287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc897cf00e6b450e964cf9979fd5fc15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99a8c0e-61", "ovs_interfaceid": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-42e4c4f7-64e7-49aa-8c3e-2f38ca3431cf req-d9385dd8-0793-4a7a-9ac7-39950c0e3b29 service nova] Releasing lock "refresh_cache-f3367d72-f511-4285-a77b-b26932bf7490" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG os_brick.utils [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92cbe2e-eea6-473a-90a4-d6266a82d75e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5845520d-e368-40d4-be65-8c246fbe05b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a366be3-aba8-47ce-ad5a-0bb14dbbab32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d31e9a-1dbc-4e1d-8fa7-a8d405a407e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:31:31 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:31:31 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcb8a0a-f273-4e66-a9b5-e2a7c3d24322]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG os_brick.utils [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:31 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Updating existing volume attachment record: edcb73a2-1389-4821-83ce-1d6c685ddc84 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAvEhkfs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8a6c1a3-ddb9-4a38-86a5-420afe793380', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6636ad4-cc6f-4e99-b01e-c2d6480e192a', 'serial': 'd6636ad4-cc6f-4e99-b01e-c2d6480e192a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luPirdfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'e8a6c1a3-ddb9-4a38-86a5-420afe793380', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'serial'} {{(pid=80928) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAvEhkfs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:32 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:32 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:32 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c13aed-d447-489a-97ab-343323716d9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:31:32 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07c9cff-9546-4788-84f9-c06631602c3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a] added
Nov 16 05:31:32 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6b61a8-b6ca-40ee-a34f-2da65aa0854a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a0b514-cc59-4dbc-a634-86ce1a9d8a31]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GAvEhkfs {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GAvEhkfs" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa64eb15-2a5d-48b1-8c9b-f4270bdb9f3d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GAvEhkfs'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[807bfc33-dad1-42df-b423-1da92a03d51e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b06233-9f53-48a1-84f5-15dbe3f79340]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:32 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:32 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:32 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81c3852-77ce-4b3a-bbb4-6f0b242ee6d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a, portal: 172.16.0.220,3260]
Nov 16 05:31:33 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:33 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb91917-bcf6-4992-860a-ad90fe4a3ee1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[642d345e-fe0d-46f7-bb0e-009fcab3cd9d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:33 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:33 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:33 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[667b47e2-d1b7-493c-80ca-40f110b0e86a]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:31:34 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:31:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAvEhkfs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:31:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23565663037633966', 'path': '/dev/sdj'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565663037633966', 'path': '/dev/sdj'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:31:34 user nova-compute[80928]: DEBUG nova.objects.instance [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lazy-loading 'flavor' on Instance uuid e8a6c1a3-ddb9-4a38-86a5-420afe793380 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 115343360 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 214958080 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 361758720 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 494927872 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 609222656 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 740294656 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikhdPrLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:37 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:37 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:37 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3602ba-5444-4510-b898-fbdabb28a58a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:31:37 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7450990d-4d55-4a89-a8f4-25c1eb6286fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403] added
Nov 16 05:31:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e229cc-5d50-4f6a-9d08-69f9386afd67]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4632bdc-d293-493e-aa7f-e914a0b62964]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikhdPrLz {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikhdPrLz" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d637fe9-2afa-43cc-80ba-80887d554823]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ikhdPrLz'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee705ae-0105-4faa-a2df-775045612eeb]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b876800e-bf71-4788-ac2f-efd5cb48bf07]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:37 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9eefc2-9959-4056-b771-283528ad4c47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403, portal: 172.16.0.220,3260]
Nov 16 05:31:37 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[34054da3-aaa2-4201-a07a-2d8dcf6cc91f]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4248413a-1f70-45b6-bfb5-a6d1a101ba09]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:38 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c5ef67-77b5-4ea4-beff-edf1e66f02a4]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikhdPrLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 888143872 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 1058013184 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '26535316430313739', 'path': '/dev/sdk'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535316430313739', 'path': '/dev/sdk'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG nova.objects.instance [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lazy-loading 'flavor' on Instance uuid f3367d72-f511-4285-a77b-b26932bf7490 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] attach device xml: <disk type="block" device="disk">
Nov 16 05:31:39 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:39 user nova-compute[80928]:   <source dev="/dev/sdk"/>
Nov 16 05:31:39 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:31:39 user nova-compute[80928]:   <serial>1a9d880e-0cd6-4969-bd08-8cb903146403</serial>
Nov 16 05:31:39 user nova-compute[80928]: </disk>
Nov 16 05:31:39 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luPirdfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:39 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] No VIF found with MAC fa:16:3e:4f:e8:78, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeb048c-8a9b-4102-8e7b-695481127184]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:31:39 user nova-compute[80928]: No targets found.
Nov 16 05:31:39 user nova-compute[80928]: iSNS:
Nov 16 05:31:39 user nova-compute[80928]: No targets found.
Nov 16 05:31:39 user nova-compute[80928]: STATIC:
Nov 16 05:31:39 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b
Nov 16 05:31:39 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:39 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:39 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a
Nov 16 05:31:39 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:39 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:39 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872
Nov 16 05:31:39 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:39 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:39 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a
Nov 16 05:31:39 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:39 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:39 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176
Nov 16 05:31:39 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:39 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:39 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05
Nov 16 05:31:39 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:39 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:39 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:31:39 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:39 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:39 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403
Nov 16 05:31:39 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:39 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:39 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2
Nov 16 05:31:39 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:39 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:39 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc
Nov 16 05:31:39 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:39 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:39 user nova-compute[80928]: FIRMWARE:
Nov 16 05:31:39 user nova-compute[80928]: No targets found.
Nov 16 05:31:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:31:39 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:31:39 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e07f0c8-96e9-491d-96ee-6cd3c7371165]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce985698-8592-46e9-8699-37eb5d955aad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:39 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f869241f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872'): ({'sdi'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Removing single pathed devices sdi {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[976deb84-29f5-480a-860d-4d2c520ecadf]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84753b0-bb57-4b10-b0b0-012fe3f4468f]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Flushing IO for device /dev/sdi {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-64aab737-ac8a-447b-a7d0-e121326b6634 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lock "f3367d72-f511-4285-a77b-b26932bf7490" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.590s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eab997-1ba2-4d93-b12d-c5739e4282b3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c84faba-42db-4f75-9ac0-9f6a8da80f9a]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] SCSI volumes sdi have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2146a1d4-1fae-4640-872e-94f852aee863]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ca4c67-6efd-4060-9a38-98d8080d0895]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260]
Nov 16 05:31:39 user nova-compute[80928]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f900d7-00ef-411a-a79b-677dfbc36449]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] <== disconnect_volume: return (387ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:31:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAvEhkfs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'e8a6c1a3-ddb9-4a38-86a5-420afe793380', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6636ad4-cc6f-4e99-b01e-c2d6480e192a', 'serial'} {{(pid=80928) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 05:31:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] swap_volume: removing Cinder connection for volume f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 {{(pid=80928) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 05:31:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6a613b15-e6e9-49ea-9930-e3cbc5026e2c tempest-VolumesAssistedSnapshotsTest-1527083413 tempest-VolumesAssistedSnapshotsTest-1527083413-project] [instance: f3367d72-f511-4285-a77b-b26932bf7490] volume_snapshot_create: create_info: {'snapshot_id': '7086ea29-34b5-45b0-b9d5-1002f3c38a33', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=80928) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 16 05:31:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6a613b15-e6e9-49ea-9930-e3cbc5026e2c tempest-VolumesAssistedSnapshotsTest-1527083413 tempest-VolumesAssistedSnapshotsTest-1527083413-project] [instance: f3367d72-f511-4285-a77b-b26932bf7490] snap xml: <domainsnapshot>
Nov 16 05:31:40 user nova-compute[80928]:   <disks>
Nov 16 05:31:40 user nova-compute[80928]:     <disk name="/dev/sdk" snapshot="external" type="file">
Nov 16 05:31:40 user nova-compute[80928]:       <source file="/dev/new_file"/>
Nov 16 05:31:40 user nova-compute[80928]:     </disk>
Nov 16 05:31:40 user nova-compute[80928]:     <disk name="vda" snapshot="no"/>
Nov 16 05:31:40 user nova-compute[80928]:   </disks>
Nov 16 05:31:40 user nova-compute[80928]: </domainsnapshot>
Nov 16 05:31:40 user nova-compute[80928]:  {{(pid=80928) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 16 05:31:40 user nova-compute[80928]: DEBUG nova.objects.instance [None req-6a613b15-e6e9-49ea-9930-e3cbc5026e2c tempest-VolumesAssistedSnapshotsTest-1527083413 tempest-VolumesAssistedSnapshotsTest-1527083413-project] Lazy-loading 'system_metadata' on Instance uuid f3367d72-f511-4285-a77b-b26932bf7490 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-6a613b15-e6e9-49ea-9930-e3cbc5026e2c tempest-VolumesAssistedSnapshotsTest-1527083413 tempest-VolumesAssistedSnapshotsTest-1527083413-project] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 05:31:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-18e145a8-56da-49b7-8460-64eda2c9fe8b tempest-VolumesAssistedSnapshotsTest-1527083413 tempest-VolumesAssistedSnapshotsTest-1527083413-project] [instance: f3367d72-f511-4285-a77b-b26932bf7490] volume_snapshot_delete: delete_info: {'volume_id': '1a9d880e-0cd6-4969-bd08-8cb903146403'} {{(pid=80928) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [None req-18e145a8-56da-49b7-8460-64eda2c9fe8b tempest-VolumesAssistedSnapshotsTest-1527083413 tempest-VolumesAssistedSnapshotsTest-1527083413-project] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490] Traceback (most recent call last):
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     if delete_info['type'] != 'qcow2':
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490] KeyError: 'type'
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490] 
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [None req-6a613b15-e6e9-49ea-9930-e3cbc5026e2c tempest-VolumesAssistedSnapshotsTest-1527083413 tempest-VolumesAssistedSnapshotsTest-1527083413-project] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490] Traceback (most recent call last):
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     rv = execute(f, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     six.reraise(c, e, tb)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     raise value
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     rv = meth(*args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490] 
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [None req-6a613b15-e6e9-49ea-9930-e3cbc5026e2c tempest-VolumesAssistedSnapshotsTest-1527083413 tempest-VolumesAssistedSnapshotsTest-1527083413-project] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490] Traceback (most recent call last):
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     self._volume_snapshot_create(context, instance, guest,
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     rv = execute(f, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     six.reraise(c, e, tb)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     raise value
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     rv = meth(*args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [instance: f3367d72-f511-4285-a77b-b26932bf7490] 
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [None req-18e145a8-56da-49b7-8460-64eda2c9fe8b tempest-VolumesAssistedSnapshotsTest-1527083413 tempest-VolumesAssistedSnapshotsTest-1527083413-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver 
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver 
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-0a4ca783-f267-46cc-8721-268c46a523ab)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver 
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver 
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver 
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver [None req-6a613b15-e6e9-49ea-9930-e3cbc5026e2c tempest-VolumesAssistedSnapshotsTest-1527083413 tempest-VolumesAssistedSnapshotsTest-1527083413-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 7086ea29-34b5-45b0-b9d5-1002f3c38a33 could not be found.
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     raise value
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver 
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver 
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 7086ea29-34b5-45b0-b9d5-1002f3c38a33 could not be found. (HTTP 404) (Request-ID: req-80f0bafa-0922-494a-828a-c17a9fef0a43)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver 
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver 
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 7086ea29-34b5-45b0-b9d5-1002f3c38a33 could not be found.
Nov 16 05:31:40 user nova-compute[80928]: ERROR nova.virt.libvirt.driver 
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server [None req-18e145a8-56da-49b7-8460-64eda2c9fe8b tempest-VolumesAssistedSnapshotsTest-1527083413 tempest-VolumesAssistedSnapshotsTest-1527083413-project] Exception during message handling: KeyError: 'type'
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server 
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server [None req-6a613b15-e6e9-49ea-9930-e3cbc5026e2c tempest-VolumesAssistedSnapshotsTest-1527083413 tempest-VolumesAssistedSnapshotsTest-1527083413-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     raise value
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 05:31:40 user nova-compute[80928]: ERROR oslo_messaging.rpc.server 
Nov 16 05:31:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Acquiring lock "f3367d72-f511-4285-a77b-b26932bf7490" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lock "f3367d72-f511-4285-a77b-b26932bf7490" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:40 user nova-compute[80928]: INFO nova.compute.manager [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Detaching volume 1a9d880e-0cd6-4969-bd08-8cb903146403
Nov 16 05:31:40 user nova-compute[80928]: INFO nova.virt.block_device [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Attempting to driver detach volume 1a9d880e-0cd6-4969-bd08-8cb903146403 from mountpoint /dev/vdb
Nov 16 05:31:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Attempting to detach device vdb from instance f3367d72-f511-4285-a77b-b26932bf7490 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:31:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 05:31:40 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:40 user nova-compute[80928]:   <source dev="/dev/sdk"/>
Nov 16 05:31:40 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:31:40 user nova-compute[80928]:   <serial>1a9d880e-0cd6-4969-bd08-8cb903146403</serial>
Nov 16 05:31:40 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:31:40 user nova-compute[80928]: </disk>
Nov 16 05:31:40 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:31:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Successfully detached device vdb from instance f3367d72-f511-4285-a77b-b26932bf7490 from the persistent domain config.
Nov 16 05:31:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3367d72-f511-4285-a77b-b26932bf7490 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:31:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 05:31:40 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:40 user nova-compute[80928]:   <source dev="/dev/sdk"/>
Nov 16 05:31:40 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:31:40 user nova-compute[80928]:   <serial>1a9d880e-0cd6-4969-bd08-8cb903146403</serial>
Nov 16 05:31:40 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:31:40 user nova-compute[80928]: </disk>
Nov 16 05:31:40 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG nova.compute.manager [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] swap_volume: Updating volume f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "GAvEhkfs", "auth_password": "LgH5vEAk8eYRFm", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "d6636ad4-cc6f-4e99-b01e-c2d6480e192a"}, "status": "reserved", "instance": "e8a6c1a3-ddb9-4a38-86a5-420afe793380", "attached_at": "", "detached_at": "", "volume_id": "d6636ad4-cc6f-4e99-b01e-c2d6480e192a", "serial": "d6636ad4-cc6f-4e99-b01e-c2d6480e192a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd6636ad4-cc6f-4e99-b01e-c2d6480e192a', 'no_device': None, 'attachment_id': '536adb04-e77e-4506-9834-9e507c81d342'} {{(pid=80928) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-eae6da65-88ca-41aa-9f8f-40539b266c37 tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.965s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3367d72-f511-4285-a77b-b26932bf7490 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Acquiring lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG os_brick.utils [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f96e8c-f2fa-40eb-8592-341fa4e2ac58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f22b778-ff05-40f3-bd1f-74112377e829]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8328b5-40b2-45c2-9015-3344730155c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e95362-b361-4bea-a54d-a3a1e4d23fed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:31:41 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:31:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fcd708-a5aa-46f7-8467-c122bb2d9263]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:31:41 user nova-compute[80928]: DEBUG os_brick.utils [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:41 user nova-compute[80928]: INFO nova.compute.manager [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Swapping volume d6636ad4-cc6f-4e99-b01e-c2d6480e192a for f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872
Nov 16 05:31:42 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 556f0ce2-2601-4bbe-9b0d-d70061cdc955 is timed out.
Nov 16 05:31:42 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Successfully detached device sdc from instance 556f0ce2-2601-4bbe-9b0d-d70061cdc955 from the live domain config.
Nov 16 05:31:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDkIFomr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:42 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ab6348-9ffc-4342-b071-375091a2a261]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:31:42 user nova-compute[80928]: No targets found.
Nov 16 05:31:42 user nova-compute[80928]: iSNS:
Nov 16 05:31:42 user nova-compute[80928]: No targets found.
Nov 16 05:31:42 user nova-compute[80928]: STATIC:
Nov 16 05:31:42 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b
Nov 16 05:31:42 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:42 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:42 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a
Nov 16 05:31:42 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:42 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:42 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a
Nov 16 05:31:42 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:42 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:42 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176
Nov 16 05:31:42 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:42 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:42 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05
Nov 16 05:31:42 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:42 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:42 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:31:42 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:42 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:42 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403
Nov 16 05:31:42 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:42 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:42 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2
Nov 16 05:31:42 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:42 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:42 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc
Nov 16 05:31:42 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:42 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:42 user nova-compute[80928]: FIRMWARE:
Nov 16 05:31:42 user nova-compute[80928]: No targets found.
Nov 16 05:31:42 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:31:42 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:31:42 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22bc4a5-a1ba-4457-8f52-433d782a2393]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[02abb5b4-d960-4c92-9092-a88427d06377]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:42 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 (non-flash)
Nov 16 05:31:42 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:42 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f865859a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176'): ({'sdg'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Removing single pathed devices sdg {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e70d9-f772-40e1-a142-d7cadd853cfa]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[83524a47-9a61-42c4-b09c-ad1de4d381db]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Flushing IO for device /dev/sdg {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[382fbd6c-d4ba-425a-98eb-bd354fe95655]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c821b14-6b61-4d5a-82b2-5f34e880f908]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] SCSI volumes sdg have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7c6950-e059-4cdc-820b-97d689ac1fe8]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[472994b9-c04d-4a89-9355-435201c226d6]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176, portal: 172.16.0.220,3260]
Nov 16 05:31:42 user nova-compute[80928]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:42 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:156a5a52-0fbc-4251-a49b-67579facb176 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8765df-15f9-4c02-8e21-e07d92115eca]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] <== disconnect_volume: return (357ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:31:43 user nova-compute[80928]: DEBUG nova.objects.instance [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lazy-loading 'flavor' on Instance uuid 556f0ce2-2601-4bbe-9b0d-d70061cdc955 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5b61c402-3a87-470b-aded-85aa587d262c tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.707s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:44 user nova-compute[80928]: INFO nova.compute.manager [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Terminating instance
Nov 16 05:31:44 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:31:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG nova.compute.manager [req-476ba7e4-7a62-4ed8-914a-80f1ef19d587 req-f6989c8c-4740-48b0-a1eb-a83d2a55e771 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Received event network-vif-unplugged-7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-476ba7e4-7a62-4ed8-914a-80f1ef19d587 req-f6989c8c-4740-48b0-a1eb-a83d2a55e771 service nova] Acquiring lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-476ba7e4-7a62-4ed8-914a-80f1ef19d587 req-f6989c8c-4740-48b0-a1eb-a83d2a55e771 service nova] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-476ba7e4-7a62-4ed8-914a-80f1ef19d587 req-f6989c8c-4740-48b0-a1eb-a83d2a55e771 service nova] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG nova.compute.manager [req-476ba7e4-7a62-4ed8-914a-80f1ef19d587 req-f6989c8c-4740-48b0-a1eb-a83d2a55e771 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] No waiting events found dispatching network-vif-unplugged-7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG nova.compute.manager [req-476ba7e4-7a62-4ed8-914a-80f1ef19d587 req-f6989c8c-4740-48b0-a1eb-a83d2a55e771 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Received event network-vif-unplugged-7d457e99-6d46-412d-95d2-6feddbd6fc9e for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:45 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Instance destroyed successfully.
Nov 16 05:31:45 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lazy-loading 'resources' on Instance uuid 556f0ce2-2601-4bbe-9b0d-d70061cdc955 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1983798862',display_name='tempest-AttachSCSIVolumeTestJSON-server-1983798862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1983798862',id=7,image_ref='8dc86dcc-c46e-4344-8a8b-cb2120d563ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgO6t03wTCz41b+4SUD164w3jQ4U2+ojtTLUqCtyjMW9VTU0xVepv7bd91zxwXr9nMsngHLArPRXm+6cUhsNcMqPmtHL+9jFMaPe3UG3w45z38O7sGf1TDjYAUJm7SPsA==',key_name='tempest-keypair-443414974',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:29:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b29c8035128c48e9baa453b52c601246',ramdisk_id='',reservation_id='r-wwat2row',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8dc86dcc-c46e-4344-8a8b-cb2120d563ed',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1165101549',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1165101549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:29:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dd322343b204a89bdc69244a46d8203',uuid=556f0ce2-2601-4bbe-9b0d-d70061cdc955,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "address": "fa:16:3e:c3:ae:ba", "network": {"id": "bd23aab1-aedf-4fc6-963c-3dd404bcdb8d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-237317009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c8035128c48e9baa453b52c601246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d457e99-6d", "ovs_interfaceid": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Converting VIF {"id": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "address": "fa:16:3e:c3:ae:ba", "network": {"id": "bd23aab1-aedf-4fc6-963c-3dd404bcdb8d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-237317009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b29c8035128c48e9baa453b52c601246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d457e99-6d", "ovs_interfaceid": "7d457e99-6d46-412d-95d2-6feddbd6fc9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ae:ba,bridge_name='br-int',has_traffic_filtering=True,id=7d457e99-6d46-412d-95d2-6feddbd6fc9e,network=Network(bd23aab1-aedf-4fc6-963c-3dd404bcdb8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d457e99-6d') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG os_vif [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ae:ba,bridge_name='br-int',has_traffic_filtering=True,id=7d457e99-6d46-412d-95d2-6feddbd6fc9e,network=Network(bd23aab1-aedf-4fc6-963c-3dd404bcdb8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d457e99-6d') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d457e99-6d, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0da21fde-6ba5-41cd-a0fe-57d95fdc59da) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:45 user nova-compute[80928]: INFO os_vif [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ae:ba,bridge_name='br-int',has_traffic_filtering=True,id=7d457e99-6d46-412d-95d2-6feddbd6fc9e,network=Network(bd23aab1-aedf-4fc6-963c-3dd404bcdb8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d457e99-6d')
Nov 16 05:31:45 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Deleting instance files /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955_del
Nov 16 05:31:45 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Deletion of /opt/stack/data/nova/instances/556f0ce2-2601-4bbe-9b0d-d70061cdc955_del complete
Nov 16 05:31:45 user nova-compute[80928]: INFO nova.compute.manager [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 16 05:31:45 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:31:45 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:46 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Took 0.90 seconds to deallocate network for instance.
Nov 16 05:31:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-dfa2fa2c-e1bc-4fd2-9a76-2635f448c2ab req-a1ee1188-5da9-49b9-9c86-65aedd8ac44f service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Received event network-vif-deleted-7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:46 user nova-compute[80928]: INFO nova.compute.manager [req-dfa2fa2c-e1bc-4fd2-9a76-2635f448c2ab req-a1ee1188-5da9-49b9-9c86-65aedd8ac44f service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Neutron deleted interface 7d457e99-6d46-412d-95d2-6feddbd6fc9e; detaching it from the instance and deleting it from the info cache
Nov 16 05:31:46 user nova-compute[80928]: DEBUG nova.network.neutron [req-dfa2fa2c-e1bc-4fd2-9a76-2635f448c2ab req-a1ee1188-5da9-49b9-9c86-65aedd8ac44f service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-dfa2fa2c-e1bc-4fd2-9a76-2635f448c2ab req-a1ee1188-5da9-49b9-9c86-65aedd8ac44f service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Detach interface failed, port_id=7d457e99-6d46-412d-95d2-6feddbd6fc9e, reason: Instance 556f0ce2-2601-4bbe-9b0d-d70061cdc955 could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:46 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f is timed out.
Nov 16 05:31:46 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Successfully detached device vdb from instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f from the live domain config.
Nov 16 05:31:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrSBmFXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:46 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c8deb5-d2ef-490b-afa9-97263d9786b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:31:46 user nova-compute[80928]: No targets found.
Nov 16 05:31:46 user nova-compute[80928]: iSNS:
Nov 16 05:31:46 user nova-compute[80928]: No targets found.
Nov 16 05:31:46 user nova-compute[80928]: STATIC:
Nov 16 05:31:46 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b
Nov 16 05:31:46 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:46 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:46 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a
Nov 16 05:31:46 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:46 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:46 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a
Nov 16 05:31:46 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:46 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:46 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05
Nov 16 05:31:46 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:46 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:46 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:31:46 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:46 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:46 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403
Nov 16 05:31:46 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:46 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:46 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2
Nov 16 05:31:46 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:46 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:46 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc
Nov 16 05:31:46 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:46 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:46 user nova-compute[80928]: FIRMWARE:
Nov 16 05:31:46 user nova-compute[80928]: No targets found.
Nov 16 05:31:46 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:31:46 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:31:46 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e19d79b-031b-42aa-8140-7f22bb2e795d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a711147-0d87-46dd-bb16-06123f4bde89]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:46 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:46 user nova-compute[80928]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc (non-flash)
Nov 16 05:31:46 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc'): ({'sdh'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Removing single pathed devices sdh {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1fb651-51df-4522-ad2b-a8dc35384b4d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d835fd67-9202-4786-8e66-9a925cde5254]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Flushing IO for device /dev/sdh {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1f25db-7d0c-4e82-ba22-d92e6f62349b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:31:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.063s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6dbbb8-c332-4d27-8523-adf0e1a72fb8]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] SCSI volumes sdh have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3d362c-3d32-4d21-aad8-a5e6ed4f0cc4]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-6526a28f-ca7a-493e-ba0a-0a1cebf434ba req-ff9967a6-bb1d-43ca-b8c5-de4ab78dcd79 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Received event network-vif-plugged-7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6526a28f-ca7a-493e-ba0a-0a1cebf434ba req-ff9967a6-bb1d-43ca-b8c5-de4ab78dcd79 service nova] Acquiring lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6526a28f-ca7a-493e-ba0a-0a1cebf434ba req-ff9967a6-bb1d-43ca-b8c5-de4ab78dcd79 service nova] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6526a28f-ca7a-493e-ba0a-0a1cebf434ba req-ff9967a6-bb1d-43ca-b8c5-de4ab78dcd79 service nova] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-6526a28f-ca7a-493e-ba0a-0a1cebf434ba req-ff9967a6-bb1d-43ca-b8c5-de4ab78dcd79 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] No waiting events found dispatching network-vif-plugged-7d457e99-6d46-412d-95d2-6feddbd6fc9e {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:47 user nova-compute[80928]: WARNING nova.compute.manager [req-6526a28f-ca7a-493e-ba0a-0a1cebf434ba req-ff9967a6-bb1d-43ca-b8c5-de4ab78dcd79 service nova] [instance: 556f0ce2-2601-4bbe-9b0d-d70061cdc955] Received unexpected event network-vif-plugged-7d457e99-6d46-412d-95d2-6feddbd6fc9e for instance with vm_state deleted and task_state None.
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d66870-9829-41fc-9926-371247f56340]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc, portal: 172.16.0.220,3260]
Nov 16 05:31:47 user nova-compute[80928]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Deleted allocations for instance 556f0ce2-2601-4bbe-9b0d-d70061cdc955
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d57ef23-4788-4137-a0c2-e5ab73373efc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c7190b-f388-4862-9516-21f9cca05d2d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] <== disconnect_volume: return (372ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c8154ff5-a3c6-40ff-a4fe-6f00771ca949 tempest-AttachSCSIVolumeTestJSON-1165101549 tempest-AttachSCSIVolumeTestJSON-1165101549-project-member] Lock "556f0ce2-2601-4bbe-9b0d-d70061cdc955" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.592s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luPirdfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8a6c1a3-ddb9-4a38-86a5-420afe793380', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'serial': 'f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAvEhkfs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'd6636ad4-cc6f-4e99-b01e-c2d6480e192a'}, 'status': 'reserved', 'instance': 'e8a6c1a3-ddb9-4a38-86a5-420afe793380', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6636ad4-cc6f-4e99-b01e-c2d6480e192a', 'serial'} {{(pid=80928) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luPirdfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:47 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:47 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:47 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[173fe7bb-353c-4bc0-9579-34e1add0c075]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:31:47 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[66905552-c4a5-4b19-bf87-0e435b671dc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872] added
Nov 16 05:31:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cbac7e-4e7c-464b-ba1a-0cebd12b879a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3286aa24-5b6d-48da-a97b-41bd724bb2e1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v luPirdfI {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v luPirdfI" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e597e492-a4ed-4d27-b256-909c0a299351]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'luPirdfI'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31dc166-9b54-46a9-83ee-69da6d1eda4c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b1d518-3956-4273-a46b-25c95bf64c00]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c70253-9220-4ad5-a2aa-13a3b70bdfaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260]
Nov 16 05:31:47 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5447c09f-b6b4-4c1e-821d-a4897635aca5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cb4f05-bb3f-406c-a659-a2a20c709499]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:47 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] HCTL ('38', '-', '-', 0) found on session 13 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[59166c8f-1e3e-41b7-84c2-ba0308fca806]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luPirdfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:31:47 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lazy-loading 'flavor' on Instance uuid ff21d416-8ff1-49b5-9f2b-e55df3444e8f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c37019a1-3875-41cc-96f5-9ff7cda9a7fc tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.731s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26563643834386537', 'path': '/dev/sdg'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563643834386537', 'path': '/dev/sdg'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:31:48 user nova-compute[80928]: DEBUG nova.objects.instance [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lazy-loading 'flavor' on Instance uuid e8a6c1a3-ddb9-4a38-86a5-420afe793380 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 133169152 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 308281344 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 465567744 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-6da852b2-52b3-4faf-8a52-124bc918acd5 req-d4197965-555c-4d40-91a9-f391c18349de service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-changed-fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-6da852b2-52b3-4faf-8a52-124bc918acd5 req-d4197965-555c-4d40-91a9-f391c18349de service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing instance network info cache due to event network-changed-fd1457c1-62ef-454f-961d-50effb0739d3. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:31:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6da852b2-52b3-4faf-8a52-124bc918acd5 req-d4197965-555c-4d40-91a9-f391c18349de service nova] Acquiring lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:31:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6da852b2-52b3-4faf-8a52-124bc918acd5 req-d4197965-555c-4d40-91a9-f391c18349de service nova] Acquired lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:31:50 user nova-compute[80928]: DEBUG nova.network.neutron [req-6da852b2-52b3-4faf-8a52-124bc918acd5 req-d4197965-555c-4d40-91a9-f391c18349de service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Refreshing network info cache for port fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:31:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 605028352 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:51 user nova-compute[80928]: DEBUG nova.network.neutron [req-6da852b2-52b3-4faf-8a52-124bc918acd5 req-d4197965-555c-4d40-91a9-f391c18349de service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updated VIF entry in instance network info cache for port fd1457c1-62ef-454f-961d-50effb0739d3. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:31:51 user nova-compute[80928]: DEBUG nova.network.neutron [req-6da852b2-52b3-4faf-8a52-124bc918acd5 req-d4197965-555c-4d40-91a9-f391c18349de service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating instance_info_cache with network_info: [{"id": "fd1457c1-62ef-454f-961d-50effb0739d3", "address": "fa:16:3e:d7:88:d0", "network": {"id": "c4921244-898f-485d-83d9-27f2534bb016", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1221631381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1457c1-62", "ovs_interfaceid": "fd1457c1-62ef-454f-961d-50effb0739d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ab11ca7-0003-41bf-8689-6089a640da67", "address": "fa:16:3e:f5:4c:17", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab11ca7-00", "ovs_interfaceid": "3ab11ca7-0003-41bf-8689-6089a640da67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "address": "fa:16:3e:be:0a:cf", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef09bdc-d8", "ovs_interfaceid": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31fe312e-632b-438e-aca2-3be48e901146", "address": "fa:16:3e:79:95:2f", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fe312e-63", "ovs_interfaceid": "31fe312e-632b-438e-aca2-3be48e901146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "address": "fa:16:3e:a6:eb:47", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cabd761-23", "ovs_interfaceid": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "address": "fa:16:3e:b1:08:68", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3aee6c6-4e", "ovs_interfaceid": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37120823-c20c-4315-ad71-ee3d35752385", "address": "fa:16:3e:56:d2:9d", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37120823-c2", "ovs_interfaceid": "37120823-c20c-4315-ad71-ee3d35752385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6da852b2-52b3-4faf-8a52-124bc918acd5 req-d4197965-555c-4d40-91a9-f391c18349de service nova] Releasing lock "refresh_cache-1ff80388-e16c-41aa-966a-0446af885ba1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:31:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 774897664 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 900726784 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 1044381696 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAvEhkfs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'd6636ad4-cc6f-4e99-b01e-c2d6480e192a'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:53 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[794273fc-421d-4f82-87ad-576baf4d0324]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:31:53 user nova-compute[80928]: No targets found.
Nov 16 05:31:53 user nova-compute[80928]: iSNS:
Nov 16 05:31:53 user nova-compute[80928]: No targets found.
Nov 16 05:31:53 user nova-compute[80928]: STATIC:
Nov 16 05:31:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b
Nov 16 05:31:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a
Nov 16 05:31:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872
Nov 16 05:31:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a
Nov 16 05:31:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05
Nov 16 05:31:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:31:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403
Nov 16 05:31:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2
Nov 16 05:31:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:53 user nova-compute[80928]: FIRMWARE:
Nov 16 05:31:53 user nova-compute[80928]: No targets found.
Nov 16 05:31:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:31:53 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:31:53 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c4dd09-2bcf-4bda-bf2a-44aff4c330dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a86fe7a-9b0a-4b1f-87f2-88482e73e29c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:53 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a0310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a'): ({'sdj'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Removing single pathed devices sdj {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[90766990-4ed8-4b83-b434-0cb9aec4984d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[913f6d8e-ad69-4761-bb59-e2e50301fb83]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Flushing IO for device /dev/sdj {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[48524364-f403-4a71-808d-c4702815b59d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3bd779-ab1d-487a-8e90-8f67be43cc24]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] SCSI volumes sdj have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e64de08-7c02-459a-82f2-49e2d33f82aa]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[730d15e3-0486-4af6-b488-8c5ba1d8b37e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a, portal: 172.16.0.220,3260]
Nov 16 05:31:53 user nova-compute[80928]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6636ad4-cc6f-4e99-b01e-c2d6480e192a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8e16a8-f2e6-49db-b74c-d1c6e6939e41]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] <== disconnect_volume: return (324ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luPirdfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'e8a6c1a3-ddb9-4a38-86a5-420afe793380', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'serial'} {{(pid=80928) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] swap_volume: removing Cinder connection for volume d6636ad4-cc6f-4e99-b01e-c2d6480e192a {{(pid=80928) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "1ff80388-e16c-41aa-966a-0446af885ba1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:53 user nova-compute[80928]: INFO nova.compute.manager [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Terminating instance
Nov 16 05:31:53 user nova-compute[80928]: DEBUG nova.compute.manager [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-548502a3-b6de-4106-87a3-315ec573e9c3 req-f29a9e9e-d5f8-4328-9eb0-af31284077fe service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-548502a3-b6de-4106-87a3-315ec573e9c3 req-f29a9e9e-d5f8-4328-9eb0-af31284077fe service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-548502a3-b6de-4106-87a3-315ec573e9c3 req-f29a9e9e-d5f8-4328-9eb0-af31284077fe service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-548502a3-b6de-4106-87a3-315ec573e9c3 req-f29a9e9e-d5f8-4328-9eb0-af31284077fe service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-548502a3-b6de-4106-87a3-315ec573e9c3 req-f29a9e9e-d5f8-4328-9eb0-af31284077fe service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-unplugged-fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-548502a3-b6de-4106-87a3-315ec573e9c3 req-f29a9e9e-d5f8-4328-9eb0-af31284077fe service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-fd1457c1-62ef-454f-961d-50effb0739d3 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-0d980c31-bd41-4cd1-85d4-9dcd0d8d0476 req-41903355-f2a7-41c7-aa84-1cb0cfca363c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-3ab11ca7-0003-41bf-8689-6089a640da67 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0d980c31-bd41-4cd1-85d4-9dcd0d8d0476 req-41903355-f2a7-41c7-aa84-1cb0cfca363c service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0d980c31-bd41-4cd1-85d4-9dcd0d8d0476 req-41903355-f2a7-41c7-aa84-1cb0cfca363c service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0d980c31-bd41-4cd1-85d4-9dcd0d8d0476 req-41903355-f2a7-41c7-aa84-1cb0cfca363c service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-0d980c31-bd41-4cd1-85d4-9dcd0d8d0476 req-41903355-f2a7-41c7-aa84-1cb0cfca363c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-unplugged-3ab11ca7-0003-41bf-8689-6089a640da67 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-0d980c31-bd41-4cd1-85d4-9dcd0d8d0476 req-41903355-f2a7-41c7-aa84-1cb0cfca363c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-3ab11ca7-0003-41bf-8689-6089a640da67 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-6eb997b0-aac2-48eb-993b-781cec39e868 req-25da586e-8efb-4153-847f-2afd7d4beb9c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6eb997b0-aac2-48eb-993b-781cec39e868 req-25da586e-8efb-4153-847f-2afd7d4beb9c service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6eb997b0-aac2-48eb-993b-781cec39e868 req-25da586e-8efb-4153-847f-2afd7d4beb9c service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6eb997b0-aac2-48eb-993b-781cec39e868 req-25da586e-8efb-4153-847f-2afd7d4beb9c service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-6eb997b0-aac2-48eb-993b-781cec39e868 req-25da586e-8efb-4153-847f-2afd7d4beb9c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-unplugged-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-6eb997b0-aac2-48eb-993b-781cec39e868 req-25da586e-8efb-4153-847f-2afd7d4beb9c service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] swap_volume: Updating volume d6636ad4-cc6f-4e99-b01e-c2d6480e192a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "luPirdfI", "auth_password": "diowkSTzfWa9MV", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872"}, "status": "reserved", "instance": "e8a6c1a3-ddb9-4a38-86a5-420afe793380", "attached_at": "", "detached_at": "", "volume_id": "f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872", "serial": "f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'no_device': None, 'attachment_id': '33fce953-d527-46e4-ba69-7507f4fbeda7'} {{(pid=80928) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3c7061c7-ab37-414f-883d-13b4a68a4f6e tempest-TestVolumeSwap-1427171822 tempest-TestVolumeSwap-1427171822-project-admin] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.981s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Instance destroyed successfully.
Nov 16 05:31:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lazy-loading 'resources' on Instance uuid 1ff80388-e16c-41aa-966a-0446af885ba1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd1457c1-62ef-454f-961d-50effb0739d3", "address": "fa:16:3e:d7:88:d0", "network": {"id": "c4921244-898f-485d-83d9-27f2534bb016", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1221631381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1457c1-62", "ovs_interfaceid": "fd1457c1-62ef-454f-961d-50effb0739d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "fd1457c1-62ef-454f-961d-50effb0739d3", "address": "fa:16:3e:d7:88:d0", "network": {"id": "c4921244-898f-485d-83d9-27f2534bb016", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1221631381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1457c1-62", "ovs_interfaceid": "fd1457c1-62ef-454f-961d-50effb0739d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=fd1457c1-62ef-454f-961d-50effb0739d3,network=Network(c4921244-898f-485d-83d9-27f2534bb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1457c1-62') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=fd1457c1-62ef-454f-961d-50effb0739d3,network=Network(c4921244-898f-485d-83d9-27f2534bb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1457c1-62') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd1457c1-62, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=615fdfb4-6cd8-423e-8bed-c553c5ae818b) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: INFO os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=fd1457c1-62ef-454f-961d-50effb0739d3,network=Network(c4921244-898f-485d-83d9-27f2534bb016),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd1457c1-62')
Nov 16 05:31:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ab11ca7-0003-41bf-8689-6089a640da67", "address": "fa:16:3e:f5:4c:17", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab11ca7-00", "ovs_interfaceid": "3ab11ca7-0003-41bf-8689-6089a640da67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "3ab11ca7-0003-41bf-8689-6089a640da67", "address": "fa:16:3e:f5:4c:17", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab11ca7-00", "ovs_interfaceid": "3ab11ca7-0003-41bf-8689-6089a640da67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:4c:17,bridge_name='br-int',has_traffic_filtering=True,id=3ab11ca7-0003-41bf-8689-6089a640da67,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ab11ca7-00') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:4c:17,bridge_name='br-int',has_traffic_filtering=True,id=3ab11ca7-0003-41bf-8689-6089a640da67,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ab11ca7-00') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ab11ca7-00, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1be1d27-a4bd-4091-9e9f-8321309942d8) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: INFO os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:4c:17,bridge_name='br-int',has_traffic_filtering=True,id=3ab11ca7-0003-41bf-8689-6089a640da67,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ab11ca7-00')
Nov 16 05:31:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "address": "fa:16:3e:be:0a:cf", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef09bdc-d8", "ovs_interfaceid": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "address": "fa:16:3e:be:0a:cf", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef09bdc-d8", "ovs_interfaceid": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0a:cf,bridge_name='br-int',has_traffic_filtering=True,id=0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ef09bdc-d8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0a:cf,bridge_name='br-int',has_traffic_filtering=True,id=0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ef09bdc-d8') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ef09bdc-d8, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b1c488c-aaad-4c4e-a2f7-f2aa9edaa245) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: INFO os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0a:cf,bridge_name='br-int',has_traffic_filtering=True,id=0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ef09bdc-d8')
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31fe312e-632b-438e-aca2-3be48e901146", "address": "fa:16:3e:79:95:2f", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fe312e-63", "ovs_interfaceid": "31fe312e-632b-438e-aca2-3be48e901146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "31fe312e-632b-438e-aca2-3be48e901146", "address": "fa:16:3e:79:95:2f", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fe312e-63", "ovs_interfaceid": "31fe312e-632b-438e-aca2-3be48e901146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:95:2f,bridge_name='br-int',has_traffic_filtering=True,id=31fe312e-632b-438e-aca2-3be48e901146,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fe312e-63') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:95:2f,bridge_name='br-int',has_traffic_filtering=True,id=31fe312e-632b-438e-aca2-3be48e901146,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fe312e-63') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31fe312e-63, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c48e19a5-94fe-45d5-b97e-7dbb1f436b07) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:56 user nova-compute[80928]: WARNING nova.compute.manager [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-fd1457c1-62ef-454f-961d-50effb0739d3 for instance with vm_state active and task_state deleting.
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-unplugged-31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-31fe312e-632b-438e-aca2-3be48e901146 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:56 user nova-compute[80928]: WARNING nova.compute.manager [req-2d2d3ced-d5c0-40a7-9c9f-d40f4b033f7b req-5c6a3f4e-ed83-4147-a4fc-f6c22b68bc69 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-31fe312e-632b-438e-aca2-3be48e901146 for instance with vm_state active and task_state deleting.
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: INFO os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:95:2f,bridge_name='br-int',has_traffic_filtering=True,id=31fe312e-632b-438e-aca2-3be48e901146,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fe312e-63')
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "address": "fa:16:3e:a6:eb:47", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cabd761-23", "ovs_interfaceid": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "address": "fa:16:3e:a6:eb:47", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cabd761-23", "ovs_interfaceid": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:eb:47,bridge_name='br-int',has_traffic_filtering=True,id=3cabd761-23fe-44ac-b3c7-9778cf0d9bfc,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cabd761-23') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:eb:47,bridge_name='br-int',has_traffic_filtering=True,id=3cabd761-23fe-44ac-b3c7-9778cf0d9bfc,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cabd761-23') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cabd761-23, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=824af86e-54ac-4561-898a-a7c359ecb59f) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: INFO os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:eb:47,bridge_name='br-int',has_traffic_filtering=True,id=3cabd761-23fe-44ac-b3c7-9778cf0d9bfc,network=Network(2f48cce3-eed8-4b7b-b70c-4058bf5ff063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cabd761-23')
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "address": "fa:16:3e:b1:08:68", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3aee6c6-4e", "ovs_interfaceid": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "address": "fa:16:3e:b1:08:68", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3aee6c6-4e", "ovs_interfaceid": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:08:68,bridge_name='br-int',has_traffic_filtering=True,id=b3aee6c6-4e9c-49b4-8555-08ff64eef094,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3aee6c6-4e') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:08:68,bridge_name='br-int',has_traffic_filtering=True,id=b3aee6c6-4e9c-49b4-8555-08ff64eef094,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3aee6c6-4e') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3aee6c6-4e, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf74f673-2600-4e28-b350-cbfd1623e32f) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: INFO os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:08:68,bridge_name='br-int',has_traffic_filtering=True,id=b3aee6c6-4e9c-49b4-8555-08ff64eef094,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3aee6c6-4e')
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-361033167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-361033167',id=10,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa7xAIzaU8PHVwmpDIxaqdvTCucT9KdUuNEtRo2OD3dB8u3isNJ5oYyY8npcCf8tneCWHr4Ti+nF5qOKGFU2Qw4GR0ehegzQSxZ72QtaT1HNNZ0WLCL3xQwg2VnXUddkQ==',key_name='tempest-keypair-1197771454',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ff30b8ac9de49d8978525934fa2b6da',ramdisk_id='',reservation_id='r-ksa5o76u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1171869254',owner_user_name='tempest-TaggedBootDevicesTest_v242-1171869254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6070d3e906d74a9d93d50037d26021d5',uuid=1ff80388-e16c-41aa-966a-0446af885ba1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37120823-c20c-4315-ad71-ee3d35752385", "address": "fa:16:3e:56:d2:9d", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37120823-c2", "ovs_interfaceid": "37120823-c20c-4315-ad71-ee3d35752385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converting VIF {"id": "37120823-c20c-4315-ad71-ee3d35752385", "address": "fa:16:3e:56:d2:9d", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37120823-c2", "ovs_interfaceid": "37120823-c20c-4315-ad71-ee3d35752385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=37120823-c20c-4315-ad71-ee3d35752385,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37120823-c2') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=37120823-c20c-4315-ad71-ee3d35752385,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37120823-c2') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37120823-c2, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=503cfd14-0494-47fc-b5f4-5534a1120ade) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:56 user nova-compute[80928]: INFO os_vif [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=37120823-c20c-4315-ad71-ee3d35752385,network=Network(857144f3-5fae-44e1-92ae-a5404b196d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37120823-c2')
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-3ab11ca7-0003-41bf-8689-6089a640da67 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-3ab11ca7-0003-41bf-8689-6089a640da67 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:56 user nova-compute[80928]: WARNING nova.compute.manager [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-3ab11ca7-0003-41bf-8689-6089a640da67 for instance with vm_state active and task_state deleting.
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-unplugged-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:56 user nova-compute[80928]: WARNING nova.compute.manager [req-b1fe8c0d-9820-49f0-9011-a7a49b262604 req-e5f9954a-4e30-49fe-95ee-e24c52fe71dd service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc for instance with vm_state active and task_state deleting.
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBDxizcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:56 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:56 user nova-compute[80928]: INFO nova.compute.manager [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Detaching volume f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a667f1ca-7eaa-4edf-a524-fbc6fac891e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:31:56 user nova-compute[80928]: No targets found.
Nov 16 05:31:56 user nova-compute[80928]: iSNS:
Nov 16 05:31:56 user nova-compute[80928]: No targets found.
Nov 16 05:31:56 user nova-compute[80928]: STATIC:
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: FIRMWARE:
Nov 16 05:31:56 user nova-compute[80928]: No targets found.
Nov 16 05:31:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:31:56 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:31:56 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[196a86cb-393d-4457-b49d-f62d65e26146]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: INFO nova.virt.block_device [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Attempting to driver detach volume f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 from mountpoint /dev/vdb
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:56 user nova-compute[80928]: WARNING nova.compute.manager [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9 for instance with vm_state active and task_state deleting.
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-unplugged-37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-37120823-c20c-4315-ad71-ee3d35752385 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:56 user nova-compute[80928]: WARNING nova.compute.manager [req-fb6df649-8dc1-4572-b0d2-f6db6330d26d req-10ec2982-55a0-4798-94ad-8d5f5650c6b3 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-37120823-c20c-4315-ad71-ee3d35752385 for instance with vm_state active and task_state deleting.
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4cb97a-3c9a-4862-b7dc-d0e85c6343e2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f865859aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Attempting to detach device vdb from instance e8a6c1a3-ddb9-4a38-86a5-420afe793380 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:31:56 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:56 user nova-compute[80928]:   <source dev="/dev/sdg"/>
Nov 16 05:31:56 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:31:56 user nova-compute[80928]:   <serial>f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872</serial>
Nov 16 05:31:56 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:31:56 user nova-compute[80928]: </disk>
Nov 16 05:31:56 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:31:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Successfully detached device vdb from instance e8a6c1a3-ddb9-4a38-86a5-420afe793380 from the persistent domain config.
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e8a6c1a3-ddb9-4a38-86a5-420afe793380 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:31:56 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:31:56 user nova-compute[80928]:   <source dev="/dev/sdg"/>
Nov 16 05:31:56 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:31:56 user nova-compute[80928]:   <serial>f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872</serial>
Nov 16 05:31:56 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:31:56 user nova-compute[80928]: </disk>
Nov 16 05:31:56 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9db1ff-25c9-428b-8058-02f0bdeba58e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8152013e-4cdc-446c-a745-9fcdd062b8f7]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[80788cb3-2b29-44b5-b099-a08a726d9f12]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e534ddd-81ad-45b8-99c3-fc1de3bfd486]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2ed713-dac4-47ba-8acb-1f3b0676af18]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c029bd86-6532-4765-8d41-3553741c4ffd]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b, portal: 172.16.0.220,3260]
Nov 16 05:31:56 user nova-compute[80928]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbc22edd-058f-477d-9504-c2d18b1a130b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b01b0-e2b9-4bd9-84eb-67b159b2ef49]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] <== disconnect_volume: return (340ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgYaWDfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:56 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc7d5d1-e111-4096-b108-de265c5c0e05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:31:56 user nova-compute[80928]: No targets found.
Nov 16 05:31:56 user nova-compute[80928]: iSNS:
Nov 16 05:31:56 user nova-compute[80928]: No targets found.
Nov 16 05:31:56 user nova-compute[80928]: STATIC:
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2
Nov 16 05:31:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:56 user nova-compute[80928]: FIRMWARE:
Nov 16 05:31:56 user nova-compute[80928]: No targets found.
Nov 16 05:31:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:31:56 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:31:56 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d53d43-390d-489d-a864-5b8c1128d7fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5b5f4d-7f08-407a-82b6-6a8f5adab710]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:56 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8678230940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb7e243-dbd9-4faf-8fe7-0c959499014a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c1ff8a-78c1-4647-a79b-6d70815fef01]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa95d80-124c-4844-9761-c2d2051e9734]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d154fd-aaa1-4870-b20c-c0715eb414e0]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fb40f6-7ed7-4b6a-82d7-670ff8e36d0a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:31:56 user nova-compute[80928]: INFO nova.compute.claims [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Claim successful on node user
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e8a6c1a3-ddb9-4a38-86a5-420afe793380 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:31:56 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c398b7d9-1d5a-4eec-a085-8a793650d529]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05, portal: 172.16.0.220,3260]
Nov 16 05:31:57 user nova-compute[80928]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93aeec0-2b62-4285-af1f-3aae91221f05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b276d00d-dcfd-4227-ba93-a99eb5284a82]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] <== disconnect_volume: return (372ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyNjrYpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:31:57 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea51c6c3-b7ce-4175-a7c7-1f3e9c386bc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:31:57 user nova-compute[80928]: No targets found.
Nov 16 05:31:57 user nova-compute[80928]: iSNS:
Nov 16 05:31:57 user nova-compute[80928]: No targets found.
Nov 16 05:31:57 user nova-compute[80928]: STATIC:
Nov 16 05:31:57 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872
Nov 16 05:31:57 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:57 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:57 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a
Nov 16 05:31:57 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:57 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:57 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:31:57 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:57 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:57 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403
Nov 16 05:31:57 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:57 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:57 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2
Nov 16 05:31:57 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:31:57 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:31:57 user nova-compute[80928]: FIRMWARE:
Nov 16 05:31:57 user nova-compute[80928]: No targets found.
Nov 16 05:31:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:31:57 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:31:57 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f961495f-9474-45d1-be75-6d5dbb66265b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9f2d3f-8251-43f7-a4d1-7083dd07ce0e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:57 user nova-compute[80928]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:57 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:57 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:57 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:31:57 user nova-compute[80928]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:31:57 user nova-compute[80928]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 (non-flash)
Nov 16 05:31:57 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:31:57 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:31:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8678233520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2'): ({'sdd'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Removing single pathed devices sdd {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[428c1f17-4755-4a6f-8a16-e2b55409e1ff]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a136d1e6-de7f-43d0-8a3a-55dd24de861c]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Flushing IO for device /dev/sdd {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df37fd5-97ee-4ca7-a639-7eb6e6983e1e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b012a692-1233-403e-8dcb-63000db4c3ac]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4cbdd9-1692-4c02-a50d-0e2efae56ca4]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0984f6f6-9c14-4dfa-b318-19828fcc8660]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2, portal: 172.16.0.220,3260]
Nov 16 05:31:57 user nova-compute[80928]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2, portal: 172.16.0.220,3260] successful.
Nov 16 05:31:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957229e1-99fd-4d7d-b9e3-3a8ee4c7baf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b592829-8000-44fd-9411-9a9d6789a24e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] <== disconnect_volume: return (315ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:31:57 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Deleting instance files /opt/stack/data/nova/instances/1ff80388-e16c-41aa-966a-0446af885ba1_del
Nov 16 05:31:57 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Deletion of /opt/stack/data/nova/instances/1ff80388-e16c-41aa-966a-0446af885ba1_del complete
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:31:57 user nova-compute[80928]: INFO nova.compute.manager [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Took 3.70 seconds to destroy the instance on the hypervisor.
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:31:57 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:31:57 user nova-compute[80928]: INFO nova.virt.block_device [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Booting with blank volume at /dev/vda
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.policy [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bb9af29de44488282666171f2bcad47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995121e71e234f60b7f7d5ac0abcc0f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updating instance_info_cache with network_info: [{"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:31:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Successfully created port: af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-5619394e-1ac2-470a-881c-ae3d9131cfc1 req-232f352d-561a-4bd2-9e21-6f559124b8d9 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5619394e-1ac2-470a-881c-ae3d9131cfc1 req-232f352d-561a-4bd2-9e21-6f559124b8d9 service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5619394e-1ac2-470a-881c-ae3d9131cfc1 req-232f352d-561a-4bd2-9e21-6f559124b8d9 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5619394e-1ac2-470a-881c-ae3d9131cfc1 req-232f352d-561a-4bd2-9e21-6f559124b8d9 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-5619394e-1ac2-470a-881c-ae3d9131cfc1 req-232f352d-561a-4bd2-9e21-6f559124b8d9 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-unplugged-b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-5619394e-1ac2-470a-881c-ae3d9131cfc1 req-232f352d-561a-4bd2-9e21-6f559124b8d9 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-unplugged-b3aee6c6-4e9c-49b4-8555-08ff64eef094 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-5619394e-1ac2-470a-881c-ae3d9131cfc1 req-232f352d-561a-4bd2-9e21-6f559124b8d9 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-plugged-b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5619394e-1ac2-470a-881c-ae3d9131cfc1 req-232f352d-561a-4bd2-9e21-6f559124b8d9 service nova] Acquiring lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5619394e-1ac2-470a-881c-ae3d9131cfc1 req-232f352d-561a-4bd2-9e21-6f559124b8d9 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5619394e-1ac2-470a-881c-ae3d9131cfc1 req-232f352d-561a-4bd2-9e21-6f559124b8d9 service nova] Lock "1ff80388-e16c-41aa-966a-0446af885ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-5619394e-1ac2-470a-881c-ae3d9131cfc1 req-232f352d-561a-4bd2-9e21-6f559124b8d9 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] No waiting events found dispatching network-vif-plugged-b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:31:58 user nova-compute[80928]: WARNING nova.compute.manager [req-5619394e-1ac2-470a-881c-ae3d9131cfc1 req-232f352d-561a-4bd2-9e21-6f559124b8d9 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received unexpected event network-vif-plugged-b3aee6c6-4e9c-49b4-8555-08ff64eef094 for instance with vm_state active and task_state deleting.
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Successfully updated port: af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquired lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-5cd52081-bb7d-4229-baae-b81d9b9b303b req-c2089848-ad2b-4a6c-8d7e-0ceb401530fb service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-changed-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-5cd52081-bb7d-4229-baae-b81d9b9b303b req-c2089848-ad2b-4a6c-8d7e-0ceb401530fb service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Refreshing instance network info cache due to event network-changed-af4426f7-2ac8-4035-98b1-7739d2acf95b. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5cd52081-bb7d-4229-baae-b81d9b9b303b req-c2089848-ad2b-4a6c-8d7e-0ceb401530fb service nova] Acquiring lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Updating instance_info_cache with network_info: [{"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Releasing lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Instance network_info: |[{"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5cd52081-bb7d-4229-baae-b81d9b9b303b req-c2089848-ad2b-4a6c-8d7e-0ceb401530fb service nova] Acquired lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG nova.network.neutron [req-5cd52081-bb7d-4229-baae-b81d9b9b303b req-c2089848-ad2b-4a6c-8d7e-0ceb401530fb service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Refreshing network info cache for port af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG nova.network.neutron [req-5cd52081-bb7d-4229-baae-b81d9b9b303b req-c2089848-ad2b-4a6c-8d7e-0ceb401530fb service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Updated VIF entry in instance network info cache for port af4426f7-2ac8-4035-98b1-7739d2acf95b. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG nova.network.neutron [req-5cd52081-bb7d-4229-baae-b81d9b9b303b req-c2089848-ad2b-4a6c-8d7e-0ceb401530fb service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Updating instance_info_cache with network_info: [{"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5cd52081-bb7d-4229-baae-b81d9b9b303b req-c2089848-ad2b-4a6c-8d7e-0ceb401530fb service nova] Releasing lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:31:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-d3b9bb32-aa17-4bd4-bd2b-2faa21819623 req-3e3c3209-4055-4532-bd7a-3e2bb7ba5c2a service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-deleted-31fe312e-632b-438e-aca2-3be48e901146 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:00 user nova-compute[80928]: INFO nova.compute.manager [req-d3b9bb32-aa17-4bd4-bd2b-2faa21819623 req-3e3c3209-4055-4532-bd7a-3e2bb7ba5c2a service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Neutron deleted interface 31fe312e-632b-438e-aca2-3be48e901146; detaching it from the instance and deleting it from the info cache
Nov 16 05:32:00 user nova-compute[80928]: DEBUG nova.network.neutron [req-d3b9bb32-aa17-4bd4-bd2b-2faa21819623 req-3e3c3209-4055-4532-bd7a-3e2bb7ba5c2a service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating instance_info_cache with network_info: [{"id": "fd1457c1-62ef-454f-961d-50effb0739d3", "address": "fa:16:3e:d7:88:d0", "network": {"id": "c4921244-898f-485d-83d9-27f2534bb016", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1221631381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd1457c1-62", "ovs_interfaceid": "fd1457c1-62ef-454f-961d-50effb0739d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ab11ca7-0003-41bf-8689-6089a640da67", "address": "fa:16:3e:f5:4c:17", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab11ca7-00", "ovs_interfaceid": "3ab11ca7-0003-41bf-8689-6089a640da67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "address": "fa:16:3e:be:0a:cf", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef09bdc-d8", "ovs_interfaceid": "0ef09bdc-d8bc-4892-bf1d-d1f1124b2ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "address": "fa:16:3e:a6:eb:47", "network": {"id": "2f48cce3-eed8-4b7b-b70c-4058bf5ff063", "bridge": "br-int", "label": "tempest-device-tagging-net1-1510397313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cabd761-23", "ovs_interfaceid": "3cabd761-23fe-44ac-b3c7-9778cf0d9bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "address": "fa:16:3e:b1:08:68", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3aee6c6-4e", "ovs_interfaceid": "b3aee6c6-4e9c-49b4-8555-08ff64eef094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37120823-c20c-4315-ad71-ee3d35752385", "address": "fa:16:3e:56:d2:9d", "network": {"id": "857144f3-5fae-44e1-92ae-a5404b196d7c", "bridge": "br-int", "label": "tempest-device-tagging-net2-118981663", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ff30b8ac9de49d8978525934fa2b6da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37120823-c2", "ovs_interfaceid": "37120823-c20c-4315-ad71-ee3d35752385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-d3b9bb32-aa17-4bd4-bd2b-2faa21819623 req-3e3c3209-4055-4532-bd7a-3e2bb7ba5c2a service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Detach interface failed, port_id=31fe312e-632b-438e-aca2-3be48e901146, reason: Instance 1ff80388-e16c-41aa-966a-0446af885ba1 could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:01 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f3367d72-f511-4285-a77b-b26932bf7490 is timed out.
Nov 16 05:32:01 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Successfully detached device vdb from instance f3367d72-f511-4285-a77b-b26932bf7490 from the live domain config.
Nov 16 05:32:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] [instance: f3367d72-f511-4285-a77b-b26932bf7490] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikhdPrLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:32:01 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:32:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[92721236-fa95-4fe4-a612-9c46f4cc0aed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:32:01 user nova-compute[80928]: No targets found.
Nov 16 05:32:01 user nova-compute[80928]: iSNS:
Nov 16 05:32:01 user nova-compute[80928]: No targets found.
Nov 16 05:32:01 user nova-compute[80928]: STATIC:
Nov 16 05:32:01 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872
Nov 16 05:32:01 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:32:01 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:32:01 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a
Nov 16 05:32:01 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:32:01 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:32:01 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:32:01 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:32:01 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:32:01 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403
Nov 16 05:32:01 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:32:01 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:32:01 user nova-compute[80928]: FIRMWARE:
Nov 16 05:32:01 user nova-compute[80928]: No targets found.
Nov 16 05:32:01 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:32:01 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:32:01 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e79e5c3-6e1e-4e7e-842a-278a3d8a5d51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df159c2-0239-4a0a-9654-86e9501cf834]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:32:01 user nova-compute[80928]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:32:01 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:32:01 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:32:01 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 (non-flash)
Nov 16 05:32:01 user nova-compute[80928]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:32:01 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:32:01 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:32:01 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403'): ({'sdk'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Removing single pathed devices sdk {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acd715f-1a6e-47db-a19c-54ae2f029200]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f192745e-59af-40ea-b216-0e3c688da436]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Flushing IO for device /dev/sdk {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[074116ee-fd03-49a8-9e7b-0c59c4b962d3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.047s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acfd858-9ace-4d53-8e90-9810e7a0d8c1]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] SCSI volumes sdk have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:02 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:32:02 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7196MB free_disk=25.599300384521484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[975ec22e-3278-47d1-84b6-896958b57be5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd686a56-2220-4b2f-9ae7-09bdd790b69e]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403, portal: 172.16.0.220,3260]
Nov 16 05:32:02 user nova-compute[80928]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403, portal: 172.16.0.220,3260] successful.
Nov 16 05:32:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:02 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Took 4.73 seconds to deallocate network for instance.
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9d880e-0cd6-4969-bd08-8cb903146403 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab02ece-ef48-4dd2-ae8b-2af606062d1e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.842s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] <== disconnect_volume: return (844ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5d03bda0-20b8-497a-a87b-faee21624468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5687e588-1245-42a9-b2d8-306c3c6bf8c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance e8a6c1a3-ddb9-4a38-86a5-420afe793380 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance f3367d72-f511-4285-a77b-b26932bf7490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 1ff80388-e16c-41aa-966a-0446af885ba1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance c2e7a068-ab7d-4814-8337-b8f663188a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance fcdb0315-072c-431b-9583-400e51041f49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-dbaf4ee0-e2b7-4eaf-8a8f-cde5099e37e0 req-18b6c3b8-1850-49e1-bffc-bee2cb30b9c6 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-deleted-3cabd761-23fe-44ac-b3c7-9778cf0d9bfc {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-dbaf4ee0-e2b7-4eaf-8a8f-cde5099e37e0 req-18b6c3b8-1850-49e1-bffc-bee2cb30b9c6 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-deleted-b3aee6c6-4e9c-49b4-8555-08ff64eef094 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-dbaf4ee0-e2b7-4eaf-8a8f-cde5099e37e0 req-18b6c3b8-1850-49e1-bffc-bee2cb30b9c6 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-deleted-37120823-c20c-4315-ad71-ee3d35752385 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-dbaf4ee0-e2b7-4eaf-8a8f-cde5099e37e0 req-18b6c3b8-1850-49e1-bffc-bee2cb30b9c6 service nova] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Received event network-vif-deleted-fd1457c1-62ef-454f-961d-50effb0739d3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:32:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG nova.objects.instance [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lazy-loading 'flavor' on Instance uuid f3367d72-f511-4285-a77b-b26932bf7490 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-118c0a37-6ff3-4de6-8c53-c34c64e7a965 tempest-VolumesAssistedSnapshotsTest-2070310476 tempest-VolumesAssistedSnapshotsTest-2070310476-project-admin] Lock "f3367d72-f511-4285-a77b-b26932bf7490" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.531s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG os_brick.utils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0220e104-0db3-4b51-8bf0-62e365c0bd47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acdce84-5950-491b-b8ec-4852fcdcceb4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dd24a7-89e0-4659-964c-8cd496f649a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0e2e20-db1b-47b2-aadc-d252db71a9b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:32:03 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:32:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0d2539-8b7d-43e7-8021-ee119b4db8a6]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG os_brick.utils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:32:03 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Updating existing volume attachment record: 98b4a67e-7312-4a66-858f-1891e1f669c0 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:32:04 user nova-compute[80928]: INFO nova.compute.manager [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] [instance: 1ff80388-e16c-41aa-966a-0446af885ba1] Took 2.26 seconds to detach 3 volumes for instance.
Nov 16 05:32:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:04 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:32:04 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:32:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:04 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Deleted allocations for instance 1ff80388-e16c-41aa-966a-0446af885ba1
Nov 16 05:32:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-183a0848-d3aa-4d37-b2cb-f30423ab5e9a tempest-TaggedBootDevicesTest_v242-1171869254 tempest-TaggedBootDevicesTest_v242-1171869254-project-member] Lock "1ff80388-e16c-41aa-966a-0446af885ba1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.221s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:32:08 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Creating image(s)
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Ensure instance console log exists: /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Start _get_guest_xml network_info=[{"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPXoqICg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a39e1ed9-2651-4de2-8979-c030b02b0ee1', 'attached_at': '', 'detached_at': '', 'volume_id': '23705545-4fdf-464f-8bd3-064fcf28ed81', 'serial': '23705545-4fdf-464f-8bd3-064fcf28ed81'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '98b4a67e-7312-4a66-858f-1891e1f669c0', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:32:08 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:32:08 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPXoqICg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:32:08 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:32:08 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:32:08 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21e464f-a7f0-4404-abbc-4a796b757df8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:32:08 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bc2d14-3949-461c-b637-6c2519928066]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81] added
Nov 16 05:32:08 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4578fc13-bfca-4bfc-a4d0-f1870367c0f9]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f93fee9-d90e-451b-b4ca-e810e4802093]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPXoqICg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPXoqICg" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c519a46-74cb-4050-8c9d-6655b278c7d7]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JPXoqICg'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d717a61f-ce75-4644-b56f-303cc4a146ed]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ced76e-ac70-4eff-bd6b-064984c11160]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:32:08 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:32:08 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:32:08 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:32:08 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:32:08 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:32:08 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdc4adb-6708-4f73-8e4f-7dbc225dfdfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81, portal: 172.16.0.220,3260]
Nov 16 05:32:08 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81, portal: 172.16.0.220,3260] successful.
Nov 16 05:32:08 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e452df-18d0-46e4-8bf3-fea134f56d94]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a542a44-7062-4ed6-bce6-63aff3fde6c4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:32:08 user nova-compute[80928]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:32:08 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:32:08 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:32:08 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:32:08 user nova-compute[80928]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:32:08 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:32:08 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:32:08 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[92905c44-4184-4efc-ad13-6ca024746422]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:08 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPXoqICg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26365653965633237', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365653965633237', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:31:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-71404799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-71404799',id=14,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-l2xlwmyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:31:58Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=a39e1ed9-2651-4de2-8979-c030b02b0ee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=af4426f7-2ac8-4035-98b1-7739d2acf95b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4426f7-2a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'pci_devices' on Instance uuid a39e1ed9-2651-4de2-8979-c030b02b0ee1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:32:09 user nova-compute[80928]:   <uuid>a39e1ed9-2651-4de2-8979-c030b02b0ee1</uuid>
Nov 16 05:32:09 user nova-compute[80928]:   <name>instance-0000000e</name>
Nov 16 05:32:09 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:32:09 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:32:09 user nova-compute[80928]:   <metadata>
Nov 16 05:32:09 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:32:09 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:32:09 user nova-compute[80928]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-71404799</nova:name>
Nov 16 05:32:09 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:32:08</nova:creationTime>
Nov 16 05:32:09 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:32:09 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:32:09 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:32:09 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:32:09 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:32:09 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:32:09 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:32:09 user nova-compute[80928]:       <nova:owner>
Nov 16 05:32:09 user nova-compute[80928]:         <nova:user uuid="3bb9af29de44488282666171f2bcad47">tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member</nova:user>
Nov 16 05:32:09 user nova-compute[80928]:         <nova:project uuid="995121e71e234f60b7f7d5ac0abcc0f1">tempest-ServerBootFromVolumeStableRescueTest-1026359285</nova:project>
Nov 16 05:32:09 user nova-compute[80928]:       </nova:owner>
Nov 16 05:32:09 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:32:09 user nova-compute[80928]:       <nova:ports>
Nov 16 05:32:09 user nova-compute[80928]:         <nova:port uuid="af4426f7-2ac8-4035-98b1-7739d2acf95b">
Nov 16 05:32:09 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 05:32:09 user nova-compute[80928]:         </nova:port>
Nov 16 05:32:09 user nova-compute[80928]:       </nova:ports>
Nov 16 05:32:09 user nova-compute[80928]:     </nova:instance>
Nov 16 05:32:09 user nova-compute[80928]:   </metadata>
Nov 16 05:32:09 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:32:09 user nova-compute[80928]:     <system>
Nov 16 05:32:09 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:32:09 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:32:09 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:32:09 user nova-compute[80928]:       <entry name="serial">a39e1ed9-2651-4de2-8979-c030b02b0ee1</entry>
Nov 16 05:32:09 user nova-compute[80928]:       <entry name="uuid">a39e1ed9-2651-4de2-8979-c030b02b0ee1</entry>
Nov 16 05:32:09 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:32:09 user nova-compute[80928]:     </system>
Nov 16 05:32:09 user nova-compute[80928]:   </sysinfo>
Nov 16 05:32:09 user nova-compute[80928]:   <os>
Nov 16 05:32:09 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:32:09 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:32:09 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:32:09 user nova-compute[80928]:   </os>
Nov 16 05:32:09 user nova-compute[80928]:   <features>
Nov 16 05:32:09 user nova-compute[80928]:     <acpi/>
Nov 16 05:32:09 user nova-compute[80928]:     <apic/>
Nov 16 05:32:09 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:32:09 user nova-compute[80928]:   </features>
Nov 16 05:32:09 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:32:09 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:32:09 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:32:09 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:32:09 user nova-compute[80928]:   </clock>
Nov 16 05:32:09 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:32:09 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:32:09 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:32:09 user nova-compute[80928]:   </cpu>
Nov 16 05:32:09 user nova-compute[80928]:   <devices>
Nov 16 05:32:09 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:32:09 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:32:09 user nova-compute[80928]:       <source dev="/dev/sdb"/>
Nov 16 05:32:09 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:32:09 user nova-compute[80928]:       <serial>23705545-4fdf-464f-8bd3-064fcf28ed81</serial>
Nov 16 05:32:09 user nova-compute[80928]:     </disk>
Nov 16 05:32:09 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:32:09 user nova-compute[80928]:       <mac address="fa:16:3e:e5:51:e7"/>
Nov 16 05:32:09 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:32:09 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:32:09 user nova-compute[80928]:       <target dev="tapaf4426f7-2a"/>
Nov 16 05:32:09 user nova-compute[80928]:     </interface>
Nov 16 05:32:09 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:32:09 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/console.log" append="off"/>
Nov 16 05:32:09 user nova-compute[80928]:     </serial>
Nov 16 05:32:09 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:32:09 user nova-compute[80928]:     <video>
Nov 16 05:32:09 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:32:09 user nova-compute[80928]:     </video>
Nov 16 05:32:09 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:32:09 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:32:09 user nova-compute[80928]:     </rng>
Nov 16 05:32:09 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:32:09 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:32:09 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:32:09 user nova-compute[80928]:     </memballoon>
Nov 16 05:32:09 user nova-compute[80928]:   </devices>
Nov 16 05:32:09 user nova-compute[80928]: </domain>
Nov 16 05:32:09 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:31:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-71404799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-71404799',id=14,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-l2xlwmyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:31:58Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=a39e1ed9-2651-4de2-8979-c030b02b0ee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=af4426f7-2ac8-4035-98b1-7739d2acf95b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4426f7-2a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG os_vif [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=af4426f7-2ac8-4035-98b1-7739d2acf95b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4426f7-2a') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec12e958-4e4f-59bf-acdc-8f839871742b', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf4426f7-2a, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf4426f7-2a, col_values=(('qos', UUID('d4490346-c7a0-454d-a724-834f334d9bd2')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf4426f7-2a, col_values=(('external_ids', {'iface-id': 'af4426f7-2ac8-4035-98b1-7739d2acf95b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:51:e7', 'vm-uuid': 'a39e1ed9-2651-4de2-8979-c030b02b0ee1'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:09 user nova-compute[80928]: INFO os_vif [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=af4426f7-2ac8-4035-98b1-7739d2acf95b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4426f7-2a')
Nov 16 05:32:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:32:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No VIF found with MAC fa:16:3e:e5:51:e7, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:32:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:11 user nova-compute[80928]: DEBUG nova.compute.manager [req-85ab4cbd-5c90-466a-bc94-e056f8f8973e req-f85f0abc-3a38-4c1b-8733-cb7430b6282e service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-85ab4cbd-5c90-466a-bc94-e056f8f8973e req-f85f0abc-3a38-4c1b-8733-cb7430b6282e service nova] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-85ab4cbd-5c90-466a-bc94-e056f8f8973e req-f85f0abc-3a38-4c1b-8733-cb7430b6282e service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-85ab4cbd-5c90-466a-bc94-e056f8f8973e req-f85f0abc-3a38-4c1b-8733-cb7430b6282e service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:11 user nova-compute[80928]: DEBUG nova.compute.manager [req-85ab4cbd-5c90-466a-bc94-e056f8f8973e req-f85f0abc-3a38-4c1b-8733-cb7430b6282e service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] No waiting events found dispatching network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:11 user nova-compute[80928]: WARNING nova.compute.manager [req-85ab4cbd-5c90-466a-bc94-e056f8f8973e req-f85f0abc-3a38-4c1b-8733-cb7430b6282e service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received unexpected event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b for instance with vm_state building and task_state spawning.
Nov 16 05:32:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:32:13 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Instance spawned successfully.
Nov 16 05:32:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:13 user nova-compute[80928]: INFO nova.compute.manager [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 16 05:32:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:32:13 user nova-compute[80928]: INFO nova.compute.manager [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Took 16.52 seconds to build instance.
Nov 16 05:32:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1712ed35-94f7-4e14-9392-1866d0475605 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.630s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-0984be58-99fb-49c9-aaee-b8b86e7ad7fb req-92240402-38a1-4f40-8191-aeaa4f9adcc0 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0984be58-99fb-49c9-aaee-b8b86e7ad7fb req-92240402-38a1-4f40-8191-aeaa4f9adcc0 service nova] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0984be58-99fb-49c9-aaee-b8b86e7ad7fb req-92240402-38a1-4f40-8191-aeaa4f9adcc0 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0984be58-99fb-49c9-aaee-b8b86e7ad7fb req-92240402-38a1-4f40-8191-aeaa4f9adcc0 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-0984be58-99fb-49c9-aaee-b8b86e7ad7fb req-92240402-38a1-4f40-8191-aeaa4f9adcc0 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] No waiting events found dispatching network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:13 user nova-compute[80928]: WARNING nova.compute.manager [req-0984be58-99fb-49c9-aaee-b8b86e7ad7fb req-92240402-38a1-4f40-8191-aeaa4f9adcc0 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received unexpected event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b for instance with vm_state active and task_state None.
Nov 16 05:32:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:16 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e8a6c1a3-ddb9-4a38-86a5-420afe793380 is timed out.
Nov 16 05:32:16 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Successfully detached device vdb from instance e8a6c1a3-ddb9-4a38-86a5-420afe793380 from the live domain config.
Nov 16 05:32:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:32:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luPirdfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:32:16 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:32:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:32:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:32:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:16 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[133e853a-20d1-433d-a951-b3052fd9d8fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:32:16 user nova-compute[80928]: No targets found.
Nov 16 05:32:16 user nova-compute[80928]: iSNS:
Nov 16 05:32:16 user nova-compute[80928]: No targets found.
Nov 16 05:32:16 user nova-compute[80928]: STATIC:
Nov 16 05:32:16 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872
Nov 16 05:32:16 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:32:16 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:32:16 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a
Nov 16 05:32:16 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:32:16 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:32:16 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:32:16 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:32:16 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:32:16 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:32:16 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:32:16 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:32:16 user nova-compute[80928]: FIRMWARE:
Nov 16 05:32:16 user nova-compute[80928]: No targets found.
Nov 16 05:32:16 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:32:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:32:16 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:32:16 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:32:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:32:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3ba72-5c4a-4f42-9f00-97aa0b956f35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[df27a680-5ceb-4fa6-b781-6d1db1e46a3e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:32:17 user nova-compute[80928]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:32:17 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:32:17 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:32:17 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 (non-flash)
Nov 16 05:32:17 user nova-compute[80928]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:32:17 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:32:17 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:32:17 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8678230820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872'): ({'sdg'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Removing single pathed devices sdg {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2540a4a9-8bea-4247-a464-a326c694e878]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ea5f0b-f86f-444f-8b3b-e4d3c2a54ffd]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Flushing IO for device /dev/sdg {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ca1c54-b348-478f-b488-d4cf3510609b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c88b24-a1d7-4192-8431-aff467a32382]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] SCSI volumes sdg have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b6e270-fa3b-4322-8b9c-f82dcb8a1785]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c579c361-2634-4f59-a6e8-1b873533a89e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260]
Nov 16 05:32:17 user nova-compute[80928]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872, portal: 172.16.0.220,3260] successful.
Nov 16 05:32:17 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ee7d0a-ced7-436b-88bc-f1dbe4bc1872 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9123c4-6b39-4897-9769-a53653371ab1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] <== disconnect_volume: return (316ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "d5e15464-01b2-4ad5-85e2-deeca243ceae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:32:17 user nova-compute[80928]: INFO nova.compute.claims [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Claim successful on node user
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lazy-loading 'flavor' on Instance uuid e8a6c1a3-ddb9-4a38-86a5-420afe793380 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e9db0337-fa13-4885-b896-daaba16bbebf tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.796s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:32:18 user nova-compute[80928]: INFO nova.compute.claims [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Claim successful on node user
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:32:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:32:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Creating image(s)
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "/opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "/opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.policy [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c3163e6f11b436f980f9ffc443d4d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd2b878ead545479dc4546aab5a076e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG nova.network.neutron [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk 1073741824" returned: 0 in 0.060s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:19 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.policy [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aee02ffd699942259a6f10355af24e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070f9d7fdfa47138f3f58b567211b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:32:19 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Creating image(s)
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Successfully created port: 87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Cannot resize image /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Ensure instance console log exists: /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.171s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk 1073741824" returned: 0 in 0.064s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Successfully updated port: 87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.compute.manager [req-24e5cd47-ac9b-4cc7-b7de-10fce8a64c5c req-2cdbc0ac-d25a-4443-8f07-e02fe7e4457a service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Received event network-changed-87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.compute.manager [req-24e5cd47-ac9b-4cc7-b7de-10fce8a64c5c req-2cdbc0ac-d25a-4443-8f07-e02fe7e4457a service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Refreshing instance network info cache due to event network-changed-87ae38df-dd48-469c-9387-5ab98e6a8430. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-24e5cd47-ac9b-4cc7-b7de-10fce8a64c5c req-2cdbc0ac-d25a-4443-8f07-e02fe7e4457a service nova] Acquiring lock "refresh_cache-d5e15464-01b2-4ad5-85e2-deeca243ceae" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-24e5cd47-ac9b-4cc7-b7de-10fce8a64c5c req-2cdbc0ac-d25a-4443-8f07-e02fe7e4457a service nova] Acquired lock "refresh_cache-d5e15464-01b2-4ad5-85e2-deeca243ceae" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.network.neutron [req-24e5cd47-ac9b-4cc7-b7de-10fce8a64c5c req-2cdbc0ac-d25a-4443-8f07-e02fe7e4457a service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Refreshing network info cache for port 87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "refresh_cache-d5e15464-01b2-4ad5-85e2-deeca243ceae" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.network.neutron [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Successfully created port: 5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:32:19 user nova-compute[80928]: DEBUG nova.network.neutron [req-24e5cd47-ac9b-4cc7-b7de-10fce8a64c5c req-2cdbc0ac-d25a-4443-8f07-e02fe7e4457a service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Cannot resize image /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Ensure instance console log exists: /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.neutron [req-24e5cd47-ac9b-4cc7-b7de-10fce8a64c5c req-2cdbc0ac-d25a-4443-8f07-e02fe7e4457a service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-24e5cd47-ac9b-4cc7-b7de-10fce8a64c5c req-2cdbc0ac-d25a-4443-8f07-e02fe7e4457a service nova] Releasing lock "refresh_cache-d5e15464-01b2-4ad5-85e2-deeca243ceae" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquired lock "refresh_cache-d5e15464-01b2-4ad5-85e2-deeca243ceae" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Updating instance_info_cache with network_info: [{"id": "87ae38df-dd48-469c-9387-5ab98e6a8430", "address": "fa:16:3e:85:64:f6", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ae38df-dd", "ovs_interfaceid": "87ae38df-dd48-469c-9387-5ab98e6a8430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Releasing lock "refresh_cache-d5e15464-01b2-4ad5-85e2-deeca243ceae" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Instance network_info: |[{"id": "87ae38df-dd48-469c-9387-5ab98e6a8430", "address": "fa:16:3e:85:64:f6", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ae38df-dd", "ovs_interfaceid": "87ae38df-dd48-469c-9387-5ab98e6a8430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Start _get_guest_xml network_info=[{"id": "87ae38df-dd48-469c-9387-5ab98e6a8430", "address": "fa:16:3e:85:64:f6", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ae38df-dd", "ovs_interfaceid": "87ae38df-dd48-469c-9387-5ab98e6a8430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:32:20 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:32:20 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Successfully updated port: 5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1295275796',display_name='tempest-VolumesAdminNegativeTest-server-1295275796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1295275796',id=15,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cd2b878ead545479dc4546aab5a076e',ramdisk_id='',reservation_id='r-oj3bys0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1417091548',owner_user_name='tempest-VolumesAdminNegativeTest-1417091548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:32:18Z,user_data=None,user_id='4c3163e6f11b436f980f9ffc443d4d20',uuid=d5e15464-01b2-4ad5-85e2-deeca243ceae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87ae38df-dd48-469c-9387-5ab98e6a8430", "address": "fa:16:3e:85:64:f6", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ae38df-dd", "ovs_interfaceid": "87ae38df-dd48-469c-9387-5ab98e6a8430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Converting VIF {"id": "87ae38df-dd48-469c-9387-5ab98e6a8430", "address": "fa:16:3e:85:64:f6", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ae38df-dd", "ovs_interfaceid": "87ae38df-dd48-469c-9387-5ab98e6a8430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:64:f6,bridge_name='br-int',has_traffic_filtering=True,id=87ae38df-dd48-469c-9387-5ab98e6a8430,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ae38df-dd') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lazy-loading 'pci_devices' on Instance uuid d5e15464-01b2-4ad5-85e2-deeca243ceae {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9b89c1c1-cdc3-457c-ab9f-79b3c45682e0 req-0cbe7fb4-a406-4ba9-b9bf-7c77477440a3 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-changed-5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9b89c1c1-cdc3-457c-ab9f-79b3c45682e0 req-0cbe7fb4-a406-4ba9-b9bf-7c77477440a3 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Refreshing instance network info cache due to event network-changed-5d98342e-40a0-4426-977e-b9c61886687b. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9b89c1c1-cdc3-457c-ab9f-79b3c45682e0 req-0cbe7fb4-a406-4ba9-b9bf-7c77477440a3 service nova] Acquiring lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9b89c1c1-cdc3-457c-ab9f-79b3c45682e0 req-0cbe7fb4-a406-4ba9-b9bf-7c77477440a3 service nova] Acquired lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.neutron [req-9b89c1c1-cdc3-457c-ab9f-79b3c45682e0 req-0cbe7fb4-a406-4ba9-b9bf-7c77477440a3 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Refreshing network info cache for port 5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:32:20 user nova-compute[80928]:   <uuid>d5e15464-01b2-4ad5-85e2-deeca243ceae</uuid>
Nov 16 05:32:20 user nova-compute[80928]:   <name>instance-0000000f</name>
Nov 16 05:32:20 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:32:20 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:32:20 user nova-compute[80928]:   <metadata>
Nov 16 05:32:20 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:32:20 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:32:20 user nova-compute[80928]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1295275796</nova:name>
Nov 16 05:32:20 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:32:20</nova:creationTime>
Nov 16 05:32:20 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:32:20 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:32:20 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:32:20 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:32:20 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:32:20 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:32:20 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:32:20 user nova-compute[80928]:       <nova:owner>
Nov 16 05:32:20 user nova-compute[80928]:         <nova:user uuid="4c3163e6f11b436f980f9ffc443d4d20">tempest-VolumesAdminNegativeTest-1417091548-project-member</nova:user>
Nov 16 05:32:20 user nova-compute[80928]:         <nova:project uuid="0cd2b878ead545479dc4546aab5a076e">tempest-VolumesAdminNegativeTest-1417091548</nova:project>
Nov 16 05:32:20 user nova-compute[80928]:       </nova:owner>
Nov 16 05:32:20 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:32:20 user nova-compute[80928]:       <nova:ports>
Nov 16 05:32:20 user nova-compute[80928]:         <nova:port uuid="87ae38df-dd48-469c-9387-5ab98e6a8430">
Nov 16 05:32:20 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 05:32:20 user nova-compute[80928]:         </nova:port>
Nov 16 05:32:20 user nova-compute[80928]:       </nova:ports>
Nov 16 05:32:20 user nova-compute[80928]:     </nova:instance>
Nov 16 05:32:20 user nova-compute[80928]:   </metadata>
Nov 16 05:32:20 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:32:20 user nova-compute[80928]:     <system>
Nov 16 05:32:20 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:32:20 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:32:20 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:32:20 user nova-compute[80928]:       <entry name="serial">d5e15464-01b2-4ad5-85e2-deeca243ceae</entry>
Nov 16 05:32:20 user nova-compute[80928]:       <entry name="uuid">d5e15464-01b2-4ad5-85e2-deeca243ceae</entry>
Nov 16 05:32:20 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:32:20 user nova-compute[80928]:     </system>
Nov 16 05:32:20 user nova-compute[80928]:   </sysinfo>
Nov 16 05:32:20 user nova-compute[80928]:   <os>
Nov 16 05:32:20 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:32:20 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:32:20 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:32:20 user nova-compute[80928]:   </os>
Nov 16 05:32:20 user nova-compute[80928]:   <features>
Nov 16 05:32:20 user nova-compute[80928]:     <acpi/>
Nov 16 05:32:20 user nova-compute[80928]:     <apic/>
Nov 16 05:32:20 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:32:20 user nova-compute[80928]:   </features>
Nov 16 05:32:20 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:32:20 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:32:20 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:32:20 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:32:20 user nova-compute[80928]:   </clock>
Nov 16 05:32:20 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:32:20 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:32:20 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:32:20 user nova-compute[80928]:   </cpu>
Nov 16 05:32:20 user nova-compute[80928]:   <devices>
Nov 16 05:32:20 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:32:20 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:32:20 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk"/>
Nov 16 05:32:20 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:32:20 user nova-compute[80928]:     </disk>
Nov 16 05:32:20 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:32:20 user nova-compute[80928]:       <mac address="fa:16:3e:85:64:f6"/>
Nov 16 05:32:20 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:32:20 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:32:20 user nova-compute[80928]:       <target dev="tap87ae38df-dd"/>
Nov 16 05:32:20 user nova-compute[80928]:     </interface>
Nov 16 05:32:20 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:32:20 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/console.log" append="off"/>
Nov 16 05:32:20 user nova-compute[80928]:     </serial>
Nov 16 05:32:20 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:32:20 user nova-compute[80928]:     <video>
Nov 16 05:32:20 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:32:20 user nova-compute[80928]:     </video>
Nov 16 05:32:20 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:32:20 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:32:20 user nova-compute[80928]:     </rng>
Nov 16 05:32:20 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:32:20 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:32:20 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:32:20 user nova-compute[80928]:     </memballoon>
Nov 16 05:32:20 user nova-compute[80928]:   </devices>
Nov 16 05:32:20 user nova-compute[80928]: </domain>
Nov 16 05:32:20 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1295275796',display_name='tempest-VolumesAdminNegativeTest-server-1295275796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1295275796',id=15,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cd2b878ead545479dc4546aab5a076e',ramdisk_id='',reservation_id='r-oj3bys0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1417091548',owner_user_name='tempest-VolumesAdminNegativeTest-1417091548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:32:18Z,user_data=None,user_id='4c3163e6f11b436f980f9ffc443d4d20',uuid=d5e15464-01b2-4ad5-85e2-deeca243ceae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87ae38df-dd48-469c-9387-5ab98e6a8430", "address": "fa:16:3e:85:64:f6", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ae38df-dd", "ovs_interfaceid": "87ae38df-dd48-469c-9387-5ab98e6a8430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Converting VIF {"id": "87ae38df-dd48-469c-9387-5ab98e6a8430", "address": "fa:16:3e:85:64:f6", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ae38df-dd", "ovs_interfaceid": "87ae38df-dd48-469c-9387-5ab98e6a8430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:64:f6,bridge_name='br-int',has_traffic_filtering=True,id=87ae38df-dd48-469c-9387-5ab98e6a8430,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ae38df-dd') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG os_vif [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:64:f6,bridge_name='br-int',has_traffic_filtering=True,id=87ae38df-dd48-469c-9387-5ab98e6a8430,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ae38df-dd') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34aebd1a-3f1d-54b5-b6f5-75f317bca289', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87ae38df-dd, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87ae38df-dd, col_values=(('qos', UUID('80b763ac-59b1-49cb-9cd4-fe2106fe0f5e')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87ae38df-dd, col_values=(('external_ids', {'iface-id': '87ae38df-dd48-469c-9387-5ab98e6a8430', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:64:f6', 'vm-uuid': 'd5e15464-01b2-4ad5-85e2-deeca243ceae'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.neutron [req-9b89c1c1-cdc3-457c-ab9f-79b3c45682e0 req-0cbe7fb4-a406-4ba9-b9bf-7c77477440a3 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:20 user nova-compute[80928]: INFO os_vif [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:64:f6,bridge_name='br-int',has_traffic_filtering=True,id=87ae38df-dd48-469c-9387-5ab98e6a8430,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ae38df-dd')
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] No VIF found with MAC fa:16:3e:85:64:f6, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.neutron [req-9b89c1c1-cdc3-457c-ab9f-79b3c45682e0 req-0cbe7fb4-a406-4ba9-b9bf-7c77477440a3 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9b89c1c1-cdc3-457c-ab9f-79b3c45682e0 req-0cbe7fb4-a406-4ba9-b9bf-7c77477440a3 service nova] Releasing lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquired lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:32:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.network.neutron [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Updating instance_info_cache with network_info: [{"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Releasing lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Instance network_info: |[{"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Start _get_guest_xml network_info=[{"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:32:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:32:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448719116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448719116',id=16,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbrfYM9Tfxryjx25pcrdzFi6aMDXg1GtvKXo5V5iWQ1HHL8WU/nWyrqQDT+9C4YMMZjtHiahtk+lIZb+3YjTrRbWV9Wq2Su/5MArY3ntN9SR2zMGcvMMV9nYJ5E0xygtw==',key_name='tempest-keypair-1199152231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d070f9d7fdfa47138f3f58b567211b71',ramdisk_id='',reservation_id='r-6v774qk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-878046877',owner_user_name='tempest-TaggedAttachmentsTest-878046877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:32:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee02ffd699942259a6f10355af24e94',uuid=d9495878-bdc8-4448-9a96-a93168cca9dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converting VIF {"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:25:09,bridge_name='br-int',has_traffic_filtering=True,id=5d98342e-40a0-4426-977e-b9c61886687b,network=Network(188b965c-0cdc-4666-8723-052455c279ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d98342e-40') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.objects.instance [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lazy-loading 'pci_devices' on Instance uuid d9495878-bdc8-4448-9a96-a93168cca9dd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:32:21 user nova-compute[80928]:   <uuid>d9495878-bdc8-4448-9a96-a93168cca9dd</uuid>
Nov 16 05:32:21 user nova-compute[80928]:   <name>instance-00000010</name>
Nov 16 05:32:21 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:32:21 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:32:21 user nova-compute[80928]:   <metadata>
Nov 16 05:32:21 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:32:21 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:32:21 user nova-compute[80928]:       <nova:name>tempest-device-tagging-server-448719116</nova:name>
Nov 16 05:32:21 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:32:21</nova:creationTime>
Nov 16 05:32:21 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:32:21 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:32:21 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:32:21 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:32:21 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:32:21 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:32:21 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:32:21 user nova-compute[80928]:       <nova:owner>
Nov 16 05:32:21 user nova-compute[80928]:         <nova:user uuid="aee02ffd699942259a6f10355af24e94">tempest-TaggedAttachmentsTest-878046877-project-member</nova:user>
Nov 16 05:32:21 user nova-compute[80928]:         <nova:project uuid="d070f9d7fdfa47138f3f58b567211b71">tempest-TaggedAttachmentsTest-878046877</nova:project>
Nov 16 05:32:21 user nova-compute[80928]:       </nova:owner>
Nov 16 05:32:21 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:32:21 user nova-compute[80928]:       <nova:ports>
Nov 16 05:32:21 user nova-compute[80928]:         <nova:port uuid="5d98342e-40a0-4426-977e-b9c61886687b">
Nov 16 05:32:21 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 05:32:21 user nova-compute[80928]:         </nova:port>
Nov 16 05:32:21 user nova-compute[80928]:       </nova:ports>
Nov 16 05:32:21 user nova-compute[80928]:     </nova:instance>
Nov 16 05:32:21 user nova-compute[80928]:   </metadata>
Nov 16 05:32:21 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:32:21 user nova-compute[80928]:     <system>
Nov 16 05:32:21 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:32:21 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:32:21 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:32:21 user nova-compute[80928]:       <entry name="serial">d9495878-bdc8-4448-9a96-a93168cca9dd</entry>
Nov 16 05:32:21 user nova-compute[80928]:       <entry name="uuid">d9495878-bdc8-4448-9a96-a93168cca9dd</entry>
Nov 16 05:32:21 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:32:21 user nova-compute[80928]:     </system>
Nov 16 05:32:21 user nova-compute[80928]:   </sysinfo>
Nov 16 05:32:21 user nova-compute[80928]:   <os>
Nov 16 05:32:21 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:32:21 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:32:21 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:32:21 user nova-compute[80928]:   </os>
Nov 16 05:32:21 user nova-compute[80928]:   <features>
Nov 16 05:32:21 user nova-compute[80928]:     <acpi/>
Nov 16 05:32:21 user nova-compute[80928]:     <apic/>
Nov 16 05:32:21 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:32:21 user nova-compute[80928]:   </features>
Nov 16 05:32:21 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:32:21 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:32:21 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:32:21 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:32:21 user nova-compute[80928]:   </clock>
Nov 16 05:32:21 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:32:21 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:32:21 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:32:21 user nova-compute[80928]:   </cpu>
Nov 16 05:32:21 user nova-compute[80928]:   <devices>
Nov 16 05:32:21 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:32:21 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:32:21 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk"/>
Nov 16 05:32:21 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:32:21 user nova-compute[80928]:     </disk>
Nov 16 05:32:21 user nova-compute[80928]:     <disk type="file" device="cdrom">
Nov 16 05:32:21 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 05:32:21 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk.config"/>
Nov 16 05:32:21 user nova-compute[80928]:       <target dev="hda" bus="ide"/>
Nov 16 05:32:21 user nova-compute[80928]:     </disk>
Nov 16 05:32:21 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:32:21 user nova-compute[80928]:       <mac address="fa:16:3e:9d:25:09"/>
Nov 16 05:32:21 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:32:21 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:32:21 user nova-compute[80928]:       <target dev="tap5d98342e-40"/>
Nov 16 05:32:21 user nova-compute[80928]:     </interface>
Nov 16 05:32:21 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:32:21 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/console.log" append="off"/>
Nov 16 05:32:21 user nova-compute[80928]:     </serial>
Nov 16 05:32:21 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:32:21 user nova-compute[80928]:     <video>
Nov 16 05:32:21 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:32:21 user nova-compute[80928]:     </video>
Nov 16 05:32:21 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:32:21 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:32:21 user nova-compute[80928]:     </rng>
Nov 16 05:32:21 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:32:21 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:32:21 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:32:21 user nova-compute[80928]:     </memballoon>
Nov 16 05:32:21 user nova-compute[80928]:   </devices>
Nov 16 05:32:21 user nova-compute[80928]: </domain>
Nov 16 05:32:21 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448719116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448719116',id=16,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbrfYM9Tfxryjx25pcrdzFi6aMDXg1GtvKXo5V5iWQ1HHL8WU/nWyrqQDT+9C4YMMZjtHiahtk+lIZb+3YjTrRbWV9Wq2Su/5MArY3ntN9SR2zMGcvMMV9nYJ5E0xygtw==',key_name='tempest-keypair-1199152231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d070f9d7fdfa47138f3f58b567211b71',ramdisk_id='',reservation_id='r-6v774qk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-878046877',owner_user_name='tempest-TaggedAttachmentsTest-878046877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:32:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee02ffd699942259a6f10355af24e94',uuid=d9495878-bdc8-4448-9a96-a93168cca9dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converting VIF {"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:25:09,bridge_name='br-int',has_traffic_filtering=True,id=5d98342e-40a0-4426-977e-b9c61886687b,network=Network(188b965c-0cdc-4666-8723-052455c279ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d98342e-40') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG os_vif [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:25:09,bridge_name='br-int',has_traffic_filtering=True,id=5d98342e-40a0-4426-977e-b9c61886687b,network=Network(188b965c-0cdc-4666-8723-052455c279ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d98342e-40') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9192be64-724b-5fc6-b5ad-d06df5e04b11', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d98342e-40, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d98342e-40, col_values=(('qos', UUID('11e3a521-f17f-41b6-a346-24215326db37')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d98342e-40, col_values=(('external_ids', {'iface-id': '5d98342e-40a0-4426-977e-b9c61886687b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:25:09', 'vm-uuid': 'd9495878-bdc8-4448-9a96-a93168cca9dd'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:21 user nova-compute[80928]: INFO os_vif [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:25:09,bridge_name='br-int',has_traffic_filtering=True,id=5d98342e-40a0-4426-977e-b9c61886687b,network=Network(188b965c-0cdc-4666-8723-052455c279ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d98342e-40')
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] No BDM found with device name hda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] No VIF found with MAC fa:16:3e:9d:25:09, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:32:21 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Using config drive
Nov 16 05:32:21 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Creating config drive at /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk.config
Nov 16 05:32:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1ohsge3a {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1ohsge3a" returned: 0 in 0.063s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-8b1de95f-02e7-436d-8437-af6fa676326f req-25e40694-c237-40d4-bfe9-c21adebbf081 service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Received event network-vif-plugged-87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b1de95f-02e7-436d-8437-af6fa676326f req-25e40694-c237-40d4-bfe9-c21adebbf081 service nova] Acquiring lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b1de95f-02e7-436d-8437-af6fa676326f req-25e40694-c237-40d4-bfe9-c21adebbf081 service nova] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b1de95f-02e7-436d-8437-af6fa676326f req-25e40694-c237-40d4-bfe9-c21adebbf081 service nova] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-8b1de95f-02e7-436d-8437-af6fa676326f req-25e40694-c237-40d4-bfe9-c21adebbf081 service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] No waiting events found dispatching network-vif-plugged-87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:22 user nova-compute[80928]: WARNING nova.compute.manager [req-8b1de95f-02e7-436d-8437-af6fa676326f req-25e40694-c237-40d4-bfe9-c21adebbf081 service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Received unexpected event network-vif-plugged-87ae38df-dd48-469c-9387-5ab98e6a8430 for instance with vm_state building and task_state spawning.
Nov 16 05:32:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-38f6b26e-f456-4f60-be4a-8f3e570b3661 req-f74dc72d-aa57-4f52-8166-7d8147e2d271 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-changed-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-38f6b26e-f456-4f60-be4a-8f3e570b3661 req-f74dc72d-aa57-4f52-8166-7d8147e2d271 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Refreshing instance network info cache due to event network-changed-04d9eb71-77a9-453e-94e3-b5356df3a824. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-38f6b26e-f456-4f60-be4a-8f3e570b3661 req-f74dc72d-aa57-4f52-8166-7d8147e2d271 service nova] Acquiring lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-38f6b26e-f456-4f60-be4a-8f3e570b3661 req-f74dc72d-aa57-4f52-8166-7d8147e2d271 service nova] Acquired lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-38f6b26e-f456-4f60-be4a-8f3e570b3661 req-f74dc72d-aa57-4f52-8166-7d8147e2d271 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Refreshing network info cache for port 04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-38f6b26e-f456-4f60-be4a-8f3e570b3661 req-f74dc72d-aa57-4f52-8166-7d8147e2d271 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updated VIF entry in instance network info cache for port 04d9eb71-77a9-453e-94e3-b5356df3a824. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-38f6b26e-f456-4f60-be4a-8f3e570b3661 req-f74dc72d-aa57-4f52-8166-7d8147e2d271 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updating instance_info_cache with network_info: [{"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-38f6b26e-f456-4f60-be4a-8f3e570b3661 req-f74dc72d-aa57-4f52-8166-7d8147e2d271 service nova] Releasing lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:23 user nova-compute[80928]: INFO nova.compute.manager [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Shelve offloading
Nov 16 05:32:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-bd5fdfc4-32bc-440a-b584-332aa421c495 req-15d9f5ea-cab9-4038-90e7-4305013afb2a service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-vif-unplugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd5fdfc4-32bc-440a-b584-332aa421c495 req-15d9f5ea-cab9-4038-90e7-4305013afb2a service nova] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd5fdfc4-32bc-440a-b584-332aa421c495 req-15d9f5ea-cab9-4038-90e7-4305013afb2a service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd5fdfc4-32bc-440a-b584-332aa421c495 req-15d9f5ea-cab9-4038-90e7-4305013afb2a service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-bd5fdfc4-32bc-440a-b584-332aa421c495 req-15d9f5ea-cab9-4038-90e7-4305013afb2a service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] No waiting events found dispatching network-vif-unplugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:24 user nova-compute[80928]: WARNING nova.compute.manager [req-bd5fdfc4-32bc-440a-b584-332aa421c495 req-15d9f5ea-cab9-4038-90e7-4305013afb2a service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received unexpected event network-vif-unplugged-04d9eb71-77a9-453e-94e3-b5356df3a824 for instance with vm_state active and task_state shelving.
Nov 16 05:32:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-58e59094-7756-4930-bc6f-a54d60572cf2 req-cedf0ca0-24a6-4775-a09c-3a721a8f7499 service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Received event network-vif-plugged-87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-58e59094-7756-4930-bc6f-a54d60572cf2 req-cedf0ca0-24a6-4775-a09c-3a721a8f7499 service nova] Acquiring lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-58e59094-7756-4930-bc6f-a54d60572cf2 req-cedf0ca0-24a6-4775-a09c-3a721a8f7499 service nova] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-58e59094-7756-4930-bc6f-a54d60572cf2 req-cedf0ca0-24a6-4775-a09c-3a721a8f7499 service nova] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-58e59094-7756-4930-bc6f-a54d60572cf2 req-cedf0ca0-24a6-4775-a09c-3a721a8f7499 service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] No waiting events found dispatching network-vif-plugged-87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:24 user nova-compute[80928]: WARNING nova.compute.manager [req-58e59094-7756-4930-bc6f-a54d60572cf2 req-cedf0ca0-24a6-4775-a09c-3a721a8f7499 service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Received unexpected event network-vif-plugged-87ae38df-dd48-469c-9387-5ab98e6a8430 for instance with vm_state building and task_state spawning.
Nov 16 05:32:24 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Instance destroyed successfully.
Nov 16 05:32:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquired lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updating instance_info_cache with network_info: [{"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Releasing lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-8bf4db0d-c952-43fe-a6d8-f740342e63e2 req-5f7296cf-a80e-41bb-8d8a-1382e9e6edba service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-vif-plugged-5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8bf4db0d-c952-43fe-a6d8-f740342e63e2 req-5f7296cf-a80e-41bb-8d8a-1382e9e6edba service nova] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8bf4db0d-c952-43fe-a6d8-f740342e63e2 req-5f7296cf-a80e-41bb-8d8a-1382e9e6edba service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8bf4db0d-c952-43fe-a6d8-f740342e63e2 req-5f7296cf-a80e-41bb-8d8a-1382e9e6edba service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-8bf4db0d-c952-43fe-a6d8-f740342e63e2 req-5f7296cf-a80e-41bb-8d8a-1382e9e6edba service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] No waiting events found dispatching network-vif-plugged-5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:25 user nova-compute[80928]: WARNING nova.compute.manager [req-8bf4db0d-c952-43fe-a6d8-f740342e63e2 req-5f7296cf-a80e-41bb-8d8a-1382e9e6edba service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received unexpected event network-vif-plugged-5d98342e-40a0-4426-977e-b9c61886687b for instance with vm_state building and task_state spawning.
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-8bf4db0d-c952-43fe-a6d8-f740342e63e2 req-5f7296cf-a80e-41bb-8d8a-1382e9e6edba service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-vif-plugged-5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8bf4db0d-c952-43fe-a6d8-f740342e63e2 req-5f7296cf-a80e-41bb-8d8a-1382e9e6edba service nova] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8bf4db0d-c952-43fe-a6d8-f740342e63e2 req-5f7296cf-a80e-41bb-8d8a-1382e9e6edba service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8bf4db0d-c952-43fe-a6d8-f740342e63e2 req-5f7296cf-a80e-41bb-8d8a-1382e9e6edba service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-8bf4db0d-c952-43fe-a6d8-f740342e63e2 req-5f7296cf-a80e-41bb-8d8a-1382e9e6edba service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] No waiting events found dispatching network-vif-plugged-5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:25 user nova-compute[80928]: WARNING nova.compute.manager [req-8bf4db0d-c952-43fe-a6d8-f740342e63e2 req-5f7296cf-a80e-41bb-8d8a-1382e9e6edba service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received unexpected event network-vif-plugged-5d98342e-40a0-4426-977e-b9c61886687b for instance with vm_state building and task_state spawning.
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:32:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Instance spawned successfully.
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Instance destroyed successfully.
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lazy-loading 'resources' on Instance uuid 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:32:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Instance spawned successfully.
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1827874150',display_name='tempest-TestShelveInstance-server-1827874150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1827874150',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFWss00Sd4WQc30r+srzERolTutzspIKV/rkvXRQi/zJ8LopBV11TVD70W1JEyEYfSOK795SSzEE4eazoiRudHFx0MWgxud48bCYUdM+qaNBwOKSa4Ki/iqKRGsRldxRg==',key_name='tempest-TestShelveInstance-1824834473',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bd17a971f5d4b00b634af7f34b14adc',ramdisk_id='',reservation_id='r-cdd685v9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-505947026',owner_user_name='tempest-TestShelveInstance-505947026-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:30:44Z,user_data=None,user_id='7f5ae21217cf4e70864e0331e403a82f',uuid=30c2bba7-99d9-4eea-8569-bf726c6ba2c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Converting VIF {"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG os_vif [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04d9eb71-77, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0212d661-1606-427d-927c-b64f79c0b9d6) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:25 user nova-compute[80928]: INFO os_vif [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77')
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfPUCdIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:32:25 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:32:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:25 user nova-compute[80928]: INFO nova.compute.manager [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[50826084-59a5-4bd5-998f-0faa920fa3a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:32:25 user nova-compute[80928]: No targets found.
Nov 16 05:32:25 user nova-compute[80928]: iSNS:
Nov 16 05:32:25 user nova-compute[80928]: No targets found.
Nov 16 05:32:25 user nova-compute[80928]: STATIC:
Nov 16 05:32:25 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a
Nov 16 05:32:25 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:32:25 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:32:25 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:32:25 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:32:25 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:32:25 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:32:25 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:32:25 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:32:25 user nova-compute[80928]: FIRMWARE:
Nov 16 05:32:25 user nova-compute[80928]: No targets found.
Nov 16 05:32:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:32:25 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:32:25 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[13be7946-21b8-4055-84bb-6fa95a7415e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:25 user nova-compute[80928]: INFO nova.compute.manager [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Took 6.75 seconds to spawn the instance on the hypervisor.
Nov 16 05:32:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcec14d-211c-4fa5-9c1f-b7099513be5d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:32:25 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:32:25 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:32:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:32:25 user nova-compute[80928]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:32:25 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:32:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86785da950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4'): ({'sde'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Removing single pathed devices sde {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:32:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:26 user nova-compute[80928]: INFO nova.compute.manager [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Took 8.23 seconds to build instance.
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dcdd36-6f66-49b4-9741-a9272fdb6310]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0cd5ab3-1f68-4f50-8e3d-f8d706b97bc4 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.325s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff15fbb-dc55-4e43-b3e1-6d8895a4e058]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Flushing IO for device /dev/sde {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:32:26 user nova-compute[80928]: INFO nova.compute.manager [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Took 7.72 seconds to build instance.
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8b66df-7741-46a4-95f7-3083ece0789c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-21419ebf-dce9-4958-8efd-c55006fea94a tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.811s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[628a89fc-bfe3-40ee-a912-29579afc14cb]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] SCSI volumes sde have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47a66d3-1a5d-487b-956e-c5befaf72ccc]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f478eb25-637e-4fb2-9a84-84e19bf8aa9a]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260]
Nov 16 05:32:26 user nova-compute[80928]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260] successful.
Nov 16 05:32:26 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[601a6feb-f42f-4c59-abcc-12027a3ac825]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] <== disconnect_volume: return (330ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:32:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Deleting instance files /opt/stack/data/nova/instances/30c2bba7-99d9-4eea-8569-bf726c6ba2c8_del
Nov 16 05:32:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Deletion of /opt/stack/data/nova/instances/30c2bba7-99d9-4eea-8569-bf726c6ba2c8_del complete
Nov 16 05:32:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-22001dfa-bdb2-4537-bf9e-f7fc7f961d36 req-49afd1ae-8781-4214-8f59-6a187e64d756 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-22001dfa-bdb2-4537-bf9e-f7fc7f961d36 req-49afd1ae-8781-4214-8f59-6a187e64d756 service nova] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-22001dfa-bdb2-4537-bf9e-f7fc7f961d36 req-49afd1ae-8781-4214-8f59-6a187e64d756 service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-22001dfa-bdb2-4537-bf9e-f7fc7f961d36 req-49afd1ae-8781-4214-8f59-6a187e64d756 service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-22001dfa-bdb2-4537-bf9e-f7fc7f961d36 req-49afd1ae-8781-4214-8f59-6a187e64d756 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] No waiting events found dispatching network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:26 user nova-compute[80928]: WARNING nova.compute.manager [req-22001dfa-bdb2-4537-bf9e-f7fc7f961d36 req-49afd1ae-8781-4214-8f59-6a187e64d756 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received unexpected event network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 for instance with vm_state active and task_state shelving.
Nov 16 05:32:27 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Deleted allocations for instance 30c2bba7-99d9-4eea-8569-bf726c6ba2c8
Nov 16 05:32:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lazy-loading 'numa_topology' on Instance uuid 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG nova.objects.base [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Object Instance<30c2bba7-99d9-4eea-8569-bf726c6ba2c8> lazy-loaded attributes: resources,numa_topology {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-fce30ed9-527b-4f49-bb5d-4e100327d972 req-a48ff908-f4cb-4b01-bd5d-eb667bf169ae service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-changed-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-fce30ed9-527b-4f49-bb5d-4e100327d972 req-a48ff908-f4cb-4b01-bd5d-eb667bf169ae service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Refreshing instance network info cache due to event network-changed-04d9eb71-77a9-453e-94e3-b5356df3a824. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fce30ed9-527b-4f49-bb5d-4e100327d972 req-a48ff908-f4cb-4b01-bd5d-eb667bf169ae service nova] Acquiring lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fce30ed9-527b-4f49-bb5d-4e100327d972 req-a48ff908-f4cb-4b01-bd5d-eb667bf169ae service nova] Acquired lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG nova.network.neutron [req-fce30ed9-527b-4f49-bb5d-4e100327d972 req-a48ff908-f4cb-4b01-bd5d-eb667bf169ae service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Refreshing network info cache for port 04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e9617a61-41a1-4801-87db-ff3c586f39db tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.994s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG nova.network.neutron [req-fce30ed9-527b-4f49-bb5d-4e100327d972 req-a48ff908-f4cb-4b01-bd5d-eb667bf169ae service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updated VIF entry in instance network info cache for port 04d9eb71-77a9-453e-94e3-b5356df3a824. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG nova.network.neutron [req-fce30ed9-527b-4f49-bb5d-4e100327d972 req-a48ff908-f4cb-4b01-bd5d-eb667bf169ae service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updating instance_info_cache with network_info: [{"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": null, "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap04d9eb71-77", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fce30ed9-527b-4f49-bb5d-4e100327d972 req-a48ff908-f4cb-4b01-bd5d-eb667bf169ae service nova] Releasing lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:32:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Acquiring lock "f3367d72-f511-4285-a77b-b26932bf7490" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "f3367d72-f511-4285-a77b-b26932bf7490" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Acquiring lock "f3367d72-f511-4285-a77b-b26932bf7490-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "f3367d72-f511-4285-a77b-b26932bf7490-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "f3367d72-f511-4285-a77b-b26932bf7490-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:33 user nova-compute[80928]: INFO nova.compute.manager [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Terminating instance
Nov 16 05:32:33 user nova-compute[80928]: DEBUG nova.compute.manager [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-0bbf2cad-bff3-47ff-8eab-e42bd4eaad9e req-e49d6afb-babd-4de0-8bd7-a7648d1d86c8 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Received event network-vif-unplugged-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0bbf2cad-bff3-47ff-8eab-e42bd4eaad9e req-e49d6afb-babd-4de0-8bd7-a7648d1d86c8 service nova] Acquiring lock "f3367d72-f511-4285-a77b-b26932bf7490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0bbf2cad-bff3-47ff-8eab-e42bd4eaad9e req-e49d6afb-babd-4de0-8bd7-a7648d1d86c8 service nova] Lock "f3367d72-f511-4285-a77b-b26932bf7490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0bbf2cad-bff3-47ff-8eab-e42bd4eaad9e req-e49d6afb-babd-4de0-8bd7-a7648d1d86c8 service nova] Lock "f3367d72-f511-4285-a77b-b26932bf7490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-0bbf2cad-bff3-47ff-8eab-e42bd4eaad9e req-e49d6afb-babd-4de0-8bd7-a7648d1d86c8 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] No waiting events found dispatching network-vif-unplugged-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-0bbf2cad-bff3-47ff-8eab-e42bd4eaad9e req-e49d6afb-babd-4de0-8bd7-a7648d1d86c8 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Received event network-vif-unplugged-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:32:34 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Instance destroyed successfully.
Nov 16 05:32:34 user nova-compute[80928]: DEBUG nova.objects.instance [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lazy-loading 'resources' on Instance uuid f3367d72-f511-4285-a77b-b26932bf7490 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1679350400',display_name='tempest-VolumesAssistedSnapshotsTest-server-1679350400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1679350400',id=9,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoNGoaymXl5x2qmmdL3FxmuviApCX+nVXxQne4n12Yk3nOF4xfMNvHz0FXYMpSim8qXtSlKJmzdI5WMgLZAervct1yjdvwd0h+s9ahpWYIOvBvAKl1OPt/N/PTJqtoPdw==',key_name='tempest-keypair-1087333632',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:29:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc897cf00e6b450e964cf9979fd5fc15',ramdisk_id='',reservation_id='r-slcplm8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1847412678',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1847412678-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:29:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c76780e408c44031a91287a76e85cbcc',uuid=f3367d72-f511-4285-a77b-b26932bf7490,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "address": "fa:16:3e:4f:e8:78", "network": {"id": "0ba3296e-39e0-4dcc-8238-d1a8970ac672", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508086287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc897cf00e6b450e964cf9979fd5fc15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99a8c0e-61", "ovs_interfaceid": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Converting VIF {"id": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "address": "fa:16:3e:4f:e8:78", "network": {"id": "0ba3296e-39e0-4dcc-8238-d1a8970ac672", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508086287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc897cf00e6b450e964cf9979fd5fc15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf99a8c0e-61", "ovs_interfaceid": "f99a8c0e-612a-49fa-ab8b-4435ed59c9f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:e8:78,bridge_name='br-int',has_traffic_filtering=True,id=f99a8c0e-612a-49fa-ab8b-4435ed59c9f5,network=Network(0ba3296e-39e0-4dcc-8238-d1a8970ac672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99a8c0e-61') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG os_vif [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:e8:78,bridge_name='br-int',has_traffic_filtering=True,id=f99a8c0e-612a-49fa-ab8b-4435ed59c9f5,network=Network(0ba3296e-39e0-4dcc-8238-d1a8970ac672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99a8c0e-61') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf99a8c0e-61, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58deb356-4c39-45e7-98a6-010a81af8942) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:34 user nova-compute[80928]: INFO os_vif [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:e8:78,bridge_name='br-int',has_traffic_filtering=True,id=f99a8c0e-612a-49fa-ab8b-4435ed59c9f5,network=Network(0ba3296e-39e0-4dcc-8238-d1a8970ac672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf99a8c0e-61')
Nov 16 05:32:34 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Deleting instance files /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490_del
Nov 16 05:32:34 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Deletion of /opt/stack/data/nova/instances/f3367d72-f511-4285-a77b-b26932bf7490_del complete
Nov 16 05:32:34 user nova-compute[80928]: INFO nova.compute.manager [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 16 05:32:34 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:32:34 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: f3367d72-f511-4285-a77b-b26932bf7490] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:32:35 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:35 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Took 0.96 seconds to deallocate network for instance.
Nov 16 05:32:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6c6d9c8e-d150-44df-804a-8c68080ec6b2 req-1559490c-96d0-4c57-ac60-27e3d6aa1ad8 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Received event network-vif-deleted-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:35 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:32:35 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:32:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:35 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Deleted allocations for instance f3367d72-f511-4285-a77b-b26932bf7490
Nov 16 05:32:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-030761af-d68e-46ae-8609-b01c0f6e29a4 tempest-VolumesAssistedSnapshotsTest-1847412678 tempest-VolumesAssistedSnapshotsTest-1847412678-project-member] Lock "f3367d72-f511-4285-a77b-b26932bf7490" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.588s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-eb6e4edc-67de-4289-80e5-4cf51a9224ac req-33f7136d-9fba-4516-a670-3f17f7e4e866 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Received event network-vif-plugged-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-eb6e4edc-67de-4289-80e5-4cf51a9224ac req-33f7136d-9fba-4516-a670-3f17f7e4e866 service nova] Acquiring lock "f3367d72-f511-4285-a77b-b26932bf7490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-eb6e4edc-67de-4289-80e5-4cf51a9224ac req-33f7136d-9fba-4516-a670-3f17f7e4e866 service nova] Lock "f3367d72-f511-4285-a77b-b26932bf7490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-eb6e4edc-67de-4289-80e5-4cf51a9224ac req-33f7136d-9fba-4516-a670-3f17f7e4e866 service nova] Lock "f3367d72-f511-4285-a77b-b26932bf7490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-eb6e4edc-67de-4289-80e5-4cf51a9224ac req-33f7136d-9fba-4516-a670-3f17f7e4e866 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] No waiting events found dispatching network-vif-plugged-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:35 user nova-compute[80928]: WARNING nova.compute.manager [req-eb6e4edc-67de-4289-80e5-4cf51a9224ac req-33f7136d-9fba-4516-a670-3f17f7e4e866 service nova] [instance: f3367d72-f511-4285-a77b-b26932bf7490] Received unexpected event network-vif-plugged-f99a8c0e-612a-49fa-ab8b-4435ed59c9f5 for instance with vm_state deleted and task_state None.
Nov 16 05:32:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "c2e7a068-ab7d-4814-8337-b8f663188a5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:37 user nova-compute[80928]: INFO nova.compute.manager [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Terminating instance
Nov 16 05:32:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:32:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-fa7d6910-ace0-43a0-8358-de537a747d1d req-3062285b-43f6-4a94-ad5d-69043b4e4ea0 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Received event network-vif-unplugged-9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fa7d6910-ace0-43a0-8358-de537a747d1d req-3062285b-43f6-4a94-ad5d-69043b4e4ea0 service nova] Acquiring lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fa7d6910-ace0-43a0-8358-de537a747d1d req-3062285b-43f6-4a94-ad5d-69043b4e4ea0 service nova] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fa7d6910-ace0-43a0-8358-de537a747d1d req-3062285b-43f6-4a94-ad5d-69043b4e4ea0 service nova] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-fa7d6910-ace0-43a0-8358-de537a747d1d req-3062285b-43f6-4a94-ad5d-69043b4e4ea0 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] No waiting events found dispatching network-vif-unplugged-9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-fa7d6910-ace0-43a0-8358-de537a747d1d req-3062285b-43f6-4a94-ad5d-69043b4e4ea0 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Received event network-vif-unplugged-9d6d65d0-c074-438a-a7fa-1422c64d78ac for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:32:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Instance destroyed successfully.
Nov 16 05:32:38 user nova-compute[80928]: DEBUG nova.objects.instance [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lazy-loading 'resources' on Instance uuid c2e7a068-ab7d-4814-8337-b8f663188a5d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2043310304',display_name='tempest-ServersNegativeTestJSON-server-2043310304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2043310304',id=12,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:30:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b31a972c7cdc45e79d788c35ac613b0e',ramdisk_id='',reservation_id='r-dlegeut8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1596712159',owner_user_name='tempest-ServersNegativeTestJSON-1596712159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:30:55Z,user_data=None,user_id='b904db715308497cbd24bfd51a34d0f9',uuid=c2e7a068-ab7d-4814-8337-b8f663188a5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "address": "fa:16:3e:d2:b4:d0", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6d65d0-c0", "ovs_interfaceid": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Converting VIF {"id": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "address": "fa:16:3e:d2:b4:d0", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6d65d0-c0", "ovs_interfaceid": "9d6d65d0-c074-438a-a7fa-1422c64d78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=9d6d65d0-c074-438a-a7fa-1422c64d78ac,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6d65d0-c0') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG os_vif [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=9d6d65d0-c074-438a-a7fa-1422c64d78ac,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6d65d0-c0') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d6d65d0-c0, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3afdfa3-e077-4eaa-a072-291b796d7ad2) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:38 user nova-compute[80928]: INFO os_vif [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b4:d0,bridge_name='br-int',has_traffic_filtering=True,id=9d6d65d0-c074-438a-a7fa-1422c64d78ac,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6d65d0-c0')
Nov 16 05:32:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Deleting instance files /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d_del
Nov 16 05:32:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Deletion of /opt/stack/data/nova/instances/c2e7a068-ab7d-4814-8337-b8f663188a5d_del complete
Nov 16 05:32:38 user nova-compute[80928]: INFO nova.compute.manager [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 16 05:32:38 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:32:38 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:32:39 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-123ddfcc-7821-44fe-ab02-45ce4f93d008 req-5eccf066-9653-4ab0-9e62-fa1a0a945f88 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Received event network-vif-deleted-9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:39 user nova-compute[80928]: INFO nova.compute.manager [req-123ddfcc-7821-44fe-ab02-45ce4f93d008 req-5eccf066-9653-4ab0-9e62-fa1a0a945f88 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Neutron deleted interface 9d6d65d0-c074-438a-a7fa-1422c64d78ac; detaching it from the instance and deleting it from the info cache
Nov 16 05:32:39 user nova-compute[80928]: DEBUG nova.network.neutron [req-123ddfcc-7821-44fe-ab02-45ce4f93d008 req-5eccf066-9653-4ab0-9e62-fa1a0a945f88 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:39 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Took 1.20 seconds to deallocate network for instance.
Nov 16 05:32:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-123ddfcc-7821-44fe-ab02-45ce4f93d008 req-5eccf066-9653-4ab0-9e62-fa1a0a945f88 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Detach interface failed, port_id=9d6d65d0-c074-438a-a7fa-1422c64d78ac, reason: Instance c2e7a068-ab7d-4814-8337-b8f663188a5d could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:32:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:40 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:32:40 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:32:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:40 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Deleted allocations for instance c2e7a068-ab7d-4814-8337-b8f663188a5d
Nov 16 05:32:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-03a52204-38ee-4eac-a7c1-9a244884b47c req-d3fc1d28-3faa-4cb4-aa07-9286df2e25b8 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Received event network-vif-plugged-9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-03a52204-38ee-4eac-a7c1-9a244884b47c req-d3fc1d28-3faa-4cb4-aa07-9286df2e25b8 service nova] Acquiring lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-03a52204-38ee-4eac-a7c1-9a244884b47c req-d3fc1d28-3faa-4cb4-aa07-9286df2e25b8 service nova] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-03a52204-38ee-4eac-a7c1-9a244884b47c req-d3fc1d28-3faa-4cb4-aa07-9286df2e25b8 service nova] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-03a52204-38ee-4eac-a7c1-9a244884b47c req-d3fc1d28-3faa-4cb4-aa07-9286df2e25b8 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] No waiting events found dispatching network-vif-plugged-9d6d65d0-c074-438a-a7fa-1422c64d78ac {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:40 user nova-compute[80928]: WARNING nova.compute.manager [req-03a52204-38ee-4eac-a7c1-9a244884b47c req-d3fc1d28-3faa-4cb4-aa07-9286df2e25b8 service nova] [instance: c2e7a068-ab7d-4814-8337-b8f663188a5d] Received unexpected event network-vif-plugged-9d6d65d0-c074-438a-a7fa-1422c64d78ac for instance with vm_state deleted and task_state None.
Nov 16 05:32:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-41941d4f-9e36-445a-9bd9-8b685d0cfeae tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "c2e7a068-ab7d-4814-8337-b8f663188a5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.771s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:46 user nova-compute[80928]: INFO nova.compute.manager [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Terminating instance
Nov 16 05:32:46 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:32:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-94902537-d6e2-4798-970b-e205445bc2f3 req-5c1539d9-7972-49b6-8cb3-dbe91b743925 service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Received event network-vif-unplugged-cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-94902537-d6e2-4798-970b-e205445bc2f3 req-5c1539d9-7972-49b6-8cb3-dbe91b743925 service nova] Acquiring lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-94902537-d6e2-4798-970b-e205445bc2f3 req-5c1539d9-7972-49b6-8cb3-dbe91b743925 service nova] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-94902537-d6e2-4798-970b-e205445bc2f3 req-5c1539d9-7972-49b6-8cb3-dbe91b743925 service nova] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-94902537-d6e2-4798-970b-e205445bc2f3 req-5c1539d9-7972-49b6-8cb3-dbe91b743925 service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] No waiting events found dispatching network-vif-unplugged-cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-94902537-d6e2-4798-970b-e205445bc2f3 req-5c1539d9-7972-49b6-8cb3-dbe91b743925 service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Received event network-vif-unplugged-cf2f55ef-66cf-4992-97ee-404155885646 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:32:47 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Instance destroyed successfully.
Nov 16 05:32:47 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lazy-loading 'resources' on Instance uuid e8a6c1a3-ddb9-4a38-86a5-420afe793380 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1935327738',display_name='tempest-TestVolumeSwap-server-1935327738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1935327738',id=8,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ+6pV9jzEIEDv4W3FgTU1ILv9iZ1P3ju+bQwN3bIuDWHMHPyJoXyLumePyHd4WZVbHHx30wKRzYcMECY5dT+rAbrCzsrEjHptsLBquh7WUo2g14x5HU0PaRGUhFm0SPg==',key_name='tempest-keypair-1571805013',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:29:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6eeae1a4a6d44f44a30ace81f6b2177d',ramdisk_id='',reservation_id='r-6ohabf29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1276851544',owner_user_name='tempest-TestVolumeSwap-1276851544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:29:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6757f9f906274bd990773e36def86a09',uuid=e8a6c1a3-ddb9-4a38-86a5-420afe793380,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf2f55ef-66cf-4992-97ee-404155885646", "address": "fa:16:3e:e1:0a:71", "network": {"id": "ddaebf50-a3a9-46ab-858a-95a4ecd44b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202869077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6eeae1a4a6d44f44a30ace81f6b2177d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2f55ef-66", "ovs_interfaceid": "cf2f55ef-66cf-4992-97ee-404155885646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Converting VIF {"id": "cf2f55ef-66cf-4992-97ee-404155885646", "address": "fa:16:3e:e1:0a:71", "network": {"id": "ddaebf50-a3a9-46ab-858a-95a4ecd44b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202869077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6eeae1a4a6d44f44a30ace81f6b2177d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2f55ef-66", "ovs_interfaceid": "cf2f55ef-66cf-4992-97ee-404155885646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0a:71,bridge_name='br-int',has_traffic_filtering=True,id=cf2f55ef-66cf-4992-97ee-404155885646,network=Network(ddaebf50-a3a9-46ab-858a-95a4ecd44b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2f55ef-66') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG os_vif [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0a:71,bridge_name='br-int',has_traffic_filtering=True,id=cf2f55ef-66cf-4992-97ee-404155885646,network=Network(ddaebf50-a3a9-46ab-858a-95a4ecd44b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2f55ef-66') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf2f55ef-66, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54558fbd-86e6-4813-a43a-f3ce5b44ae0f) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:47 user nova-compute[80928]: INFO os_vif [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0a:71,bridge_name='br-int',has_traffic_filtering=True,id=cf2f55ef-66cf-4992-97ee-404155885646,network=Network(ddaebf50-a3a9-46ab-858a-95a4ecd44b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2f55ef-66')
Nov 16 05:32:47 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Deleting instance files /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380_del
Nov 16 05:32:47 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Deletion of /opt/stack/data/nova/instances/e8a6c1a3-ddb9-4a38-86a5-420afe793380_del complete
Nov 16 05:32:47 user nova-compute[80928]: INFO nova.compute.manager [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 05:32:47 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:32:47 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:32:49 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Took 1.56 seconds to deallocate network for instance.
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-48be6483-368f-4601-ad38-96389ed5c55c req-b2b4687f-22b6-480b-8863-aec850cc2f0d service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Received event network-vif-deleted-cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:49 user nova-compute[80928]: INFO nova.compute.manager [req-48be6483-368f-4601-ad38-96389ed5c55c req-b2b4687f-22b6-480b-8863-aec850cc2f0d service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Neutron deleted interface cf2f55ef-66cf-4992-97ee-404155885646; detaching it from the instance and deleting it from the info cache
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.network.neutron [req-48be6483-368f-4601-ad38-96389ed5c55c req-b2b4687f-22b6-480b-8863-aec850cc2f0d service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-48be6483-368f-4601-ad38-96389ed5c55c req-b2b4687f-22b6-480b-8863-aec850cc2f0d service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Detach interface failed, port_id=cf2f55ef-66cf-4992-97ee-404155885646, reason: Instance e8a6c1a3-ddb9-4a38-86a5-420afe793380 could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-87e5cd0d-6972-4434-a4fb-340461f4736c req-6fbd2564-f4c1-425e-ad51-a1531c1e5007 service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Received event network-vif-plugged-cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-87e5cd0d-6972-4434-a4fb-340461f4736c req-6fbd2564-f4c1-425e-ad51-a1531c1e5007 service nova] Acquiring lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-87e5cd0d-6972-4434-a4fb-340461f4736c req-6fbd2564-f4c1-425e-ad51-a1531c1e5007 service nova] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-87e5cd0d-6972-4434-a4fb-340461f4736c req-6fbd2564-f4c1-425e-ad51-a1531c1e5007 service nova] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-87e5cd0d-6972-4434-a4fb-340461f4736c req-6fbd2564-f4c1-425e-ad51-a1531c1e5007 service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] No waiting events found dispatching network-vif-plugged-cf2f55ef-66cf-4992-97ee-404155885646 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:49 user nova-compute[80928]: WARNING nova.compute.manager [req-87e5cd0d-6972-4434-a4fb-340461f4736c req-6fbd2564-f4c1-425e-ad51-a1531c1e5007 service nova] [instance: e8a6c1a3-ddb9-4a38-86a5-420afe793380] Received unexpected event network-vif-plugged-cf2f55ef-66cf-4992-97ee-404155885646 for instance with vm_state deleted and task_state None.
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.337s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:32:49 user nova-compute[80928]: INFO nova.compute.claims [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Claim successful on node user
Nov 16 05:32:49 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Deleted allocations for instance e8a6c1a3-ddb9-4a38-86a5-420afe793380
Nov 16 05:32:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2f85b913-f2fb-4330-b895-d53b621e2ea8 tempest-TestVolumeSwap-1276851544 tempest-TestVolumeSwap-1276851544-project-member] Lock "e8a6c1a3-ddb9-4a38-86a5-420afe793380" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.990s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:32:49 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:32:49 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:32:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG nova.policy [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b1697de2fd04b27bc89ec6430a8a51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9684eff8dae04ceeb858555284d27e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:32:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Creating image(s)
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "/opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "/opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "/opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.203s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.205s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk 1073741824" returned: 0 in 0.067s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Successfully created port: 810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:32:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Cannot resize image /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Ensure instance console log exists: /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Successfully updated port: 810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "refresh_cache-859f06da-737e-40c3-9e85-2fd33052a9ea" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquired lock "refresh_cache-859f06da-737e-40c3-9e85-2fd33052a9ea" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.compute.manager [req-6a42ebfc-38bb-4530-b5a4-9115a3504d51 req-564f103f-aa09-4ead-bfa5-be812cfcb351 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received event network-changed-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.compute.manager [req-6a42ebfc-38bb-4530-b5a4-9115a3504d51 req-564f103f-aa09-4ead-bfa5-be812cfcb351 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Refreshing instance network info cache due to event network-changed-810ff4e6-46ca-448f-ba1c-047dc5db6d75. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6a42ebfc-38bb-4530-b5a4-9115a3504d51 req-564f103f-aa09-4ead-bfa5-be812cfcb351 service nova] Acquiring lock "refresh_cache-859f06da-737e-40c3-9e85-2fd33052a9ea" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Updating instance_info_cache with network_info: [{"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Releasing lock "refresh_cache-859f06da-737e-40c3-9e85-2fd33052a9ea" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Instance network_info: |[{"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6a42ebfc-38bb-4530-b5a4-9115a3504d51 req-564f103f-aa09-4ead-bfa5-be812cfcb351 service nova] Acquired lock "refresh_cache-859f06da-737e-40c3-9e85-2fd33052a9ea" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.network.neutron [req-6a42ebfc-38bb-4530-b5a4-9115a3504d51 req-564f103f-aa09-4ead-bfa5-be812cfcb351 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Refreshing network info cache for port 810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Start _get_guest_xml network_info=[{"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:32:51 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:32:51 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:32:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-33151290',display_name='tempest-tempest.common.compute-instance-33151290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-33151290',id=17,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTVVxLriAse+8lverhdQdhnvii6w45qThd0fHyb5Ol521IcYdHykJ/QxuqMWVLnXJFzh4a6SQNJa6fCD+2a2PXyDp0J+MN8Qy1Dn2CkfQ45KGGkbsS5jLLHLRnfASO6mw==',key_name='tempest-keypair-661491812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-p74fir7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:32:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=859f06da-737e-40c3-9e85-2fd33052a9ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lazy-loading 'pci_devices' on Instance uuid 859f06da-737e-40c3-9e85-2fd33052a9ea {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:32:51 user nova-compute[80928]:   <uuid>859f06da-737e-40c3-9e85-2fd33052a9ea</uuid>
Nov 16 05:32:51 user nova-compute[80928]:   <name>instance-00000011</name>
Nov 16 05:32:51 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:32:51 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:32:51 user nova-compute[80928]:   <metadata>
Nov 16 05:32:51 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:32:51 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:32:51 user nova-compute[80928]:       <nova:name>tempest-tempest.common.compute-instance-33151290</nova:name>
Nov 16 05:32:51 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:32:51</nova:creationTime>
Nov 16 05:32:51 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:32:51 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:32:51 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:32:51 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:32:51 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:32:51 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:32:51 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:32:51 user nova-compute[80928]:       <nova:owner>
Nov 16 05:32:51 user nova-compute[80928]:         <nova:user uuid="6b1697de2fd04b27bc89ec6430a8a51d">tempest-ServerActionsTestOtherA-1550926993-project-member</nova:user>
Nov 16 05:32:51 user nova-compute[80928]:         <nova:project uuid="9684eff8dae04ceeb858555284d27e39">tempest-ServerActionsTestOtherA-1550926993</nova:project>
Nov 16 05:32:51 user nova-compute[80928]:       </nova:owner>
Nov 16 05:32:51 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:32:51 user nova-compute[80928]:       <nova:ports>
Nov 16 05:32:51 user nova-compute[80928]:         <nova:port uuid="810ff4e6-46ca-448f-ba1c-047dc5db6d75">
Nov 16 05:32:51 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 05:32:51 user nova-compute[80928]:         </nova:port>
Nov 16 05:32:51 user nova-compute[80928]:       </nova:ports>
Nov 16 05:32:51 user nova-compute[80928]:     </nova:instance>
Nov 16 05:32:51 user nova-compute[80928]:   </metadata>
Nov 16 05:32:51 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:32:51 user nova-compute[80928]:     <system>
Nov 16 05:32:51 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:32:51 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:32:51 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:32:51 user nova-compute[80928]:       <entry name="serial">859f06da-737e-40c3-9e85-2fd33052a9ea</entry>
Nov 16 05:32:51 user nova-compute[80928]:       <entry name="uuid">859f06da-737e-40c3-9e85-2fd33052a9ea</entry>
Nov 16 05:32:51 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:32:51 user nova-compute[80928]:     </system>
Nov 16 05:32:51 user nova-compute[80928]:   </sysinfo>
Nov 16 05:32:51 user nova-compute[80928]:   <os>
Nov 16 05:32:51 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:32:51 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:32:51 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:32:51 user nova-compute[80928]:   </os>
Nov 16 05:32:51 user nova-compute[80928]:   <features>
Nov 16 05:32:51 user nova-compute[80928]:     <acpi/>
Nov 16 05:32:51 user nova-compute[80928]:     <apic/>
Nov 16 05:32:51 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:32:51 user nova-compute[80928]:   </features>
Nov 16 05:32:51 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:32:51 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:32:51 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:32:51 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:32:51 user nova-compute[80928]:   </clock>
Nov 16 05:32:51 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:32:51 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:32:51 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:32:51 user nova-compute[80928]:   </cpu>
Nov 16 05:32:51 user nova-compute[80928]:   <devices>
Nov 16 05:32:51 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:32:51 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:32:51 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk"/>
Nov 16 05:32:51 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:32:51 user nova-compute[80928]:     </disk>
Nov 16 05:32:51 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:32:51 user nova-compute[80928]:       <mac address="fa:16:3e:b3:20:4d"/>
Nov 16 05:32:51 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:32:51 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:32:51 user nova-compute[80928]:       <target dev="tap810ff4e6-46"/>
Nov 16 05:32:51 user nova-compute[80928]:     </interface>
Nov 16 05:32:51 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:32:51 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/console.log" append="off"/>
Nov 16 05:32:51 user nova-compute[80928]:     </serial>
Nov 16 05:32:51 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:32:51 user nova-compute[80928]:     <video>
Nov 16 05:32:51 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:32:51 user nova-compute[80928]:     </video>
Nov 16 05:32:51 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:32:51 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:32:51 user nova-compute[80928]:     </rng>
Nov 16 05:32:51 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:32:51 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:32:51 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:32:51 user nova-compute[80928]:     </memballoon>
Nov 16 05:32:51 user nova-compute[80928]:   </devices>
Nov 16 05:32:51 user nova-compute[80928]: </domain>
Nov 16 05:32:51 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:32:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-33151290',display_name='tempest-tempest.common.compute-instance-33151290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-33151290',id=17,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTVVxLriAse+8lverhdQdhnvii6w45qThd0fHyb5Ol521IcYdHykJ/QxuqMWVLnXJFzh4a6SQNJa6fCD+2a2PXyDp0J+MN8Qy1Dn2CkfQ45KGGkbsS5jLLHLRnfASO6mw==',key_name='tempest-keypair-661491812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-p74fir7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:32:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=859f06da-737e-40c3-9e85-2fd33052a9ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG os_vif [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c6e7848-3984-5f09-bbf0-b7c995a5ec15', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap810ff4e6-46, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap810ff4e6-46, col_values=(('qos', UUID('f20e36af-5fc3-487e-960e-f36553f12080')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap810ff4e6-46, col_values=(('external_ids', {'iface-id': '810ff4e6-46ca-448f-ba1c-047dc5db6d75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:20:4d', 'vm-uuid': '859f06da-737e-40c3-9e85-2fd33052a9ea'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:51 user nova-compute[80928]: INFO os_vif [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46')
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:32:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No VIF found with MAC fa:16:3e:b3:20:4d, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:32:52 user nova-compute[80928]: DEBUG nova.network.neutron [req-6a42ebfc-38bb-4530-b5a4-9115a3504d51 req-564f103f-aa09-4ead-bfa5-be812cfcb351 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Updated VIF entry in instance network info cache for port 810ff4e6-46ca-448f-ba1c-047dc5db6d75. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:32:52 user nova-compute[80928]: DEBUG nova.network.neutron [req-6a42ebfc-38bb-4530-b5a4-9115a3504d51 req-564f103f-aa09-4ead-bfa5-be812cfcb351 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Updating instance_info_cache with network_info: [{"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6a42ebfc-38bb-4530-b5a4-9115a3504d51 req-564f103f-aa09-4ead-bfa5-be812cfcb351 service nova] Releasing lock "refresh_cache-859f06da-737e-40c3-9e85-2fd33052a9ea" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:32:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:32:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:32:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-70589d99-6ee3-4294-a3dc-e9e1a07e84f8 req-1915d802-6bcc-484a-8b73-6c81fa9de889 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received event network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-70589d99-6ee3-4294-a3dc-e9e1a07e84f8 req-1915d802-6bcc-484a-8b73-6c81fa9de889 service nova] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-70589d99-6ee3-4294-a3dc-e9e1a07e84f8 req-1915d802-6bcc-484a-8b73-6c81fa9de889 service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-70589d99-6ee3-4294-a3dc-e9e1a07e84f8 req-1915d802-6bcc-484a-8b73-6c81fa9de889 service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-70589d99-6ee3-4294-a3dc-e9e1a07e84f8 req-1915d802-6bcc-484a-8b73-6c81fa9de889 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] No waiting events found dispatching network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:53 user nova-compute[80928]: WARNING nova.compute.manager [req-70589d99-6ee3-4294-a3dc-e9e1a07e84f8 req-1915d802-6bcc-484a-8b73-6c81fa9de889 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received unexpected event network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 for instance with vm_state building and task_state spawning.
Nov 16 05:32:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-f5f2798b-040f-431f-b1dd-ceef273956f4 req-c3414f27-9b3d-4d63-9e7c-6a12f46d90d1 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received event network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f5f2798b-040f-431f-b1dd-ceef273956f4 req-c3414f27-9b3d-4d63-9e7c-6a12f46d90d1 service nova] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f5f2798b-040f-431f-b1dd-ceef273956f4 req-c3414f27-9b3d-4d63-9e7c-6a12f46d90d1 service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f5f2798b-040f-431f-b1dd-ceef273956f4 req-c3414f27-9b3d-4d63-9e7c-6a12f46d90d1 service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-f5f2798b-040f-431f-b1dd-ceef273956f4 req-c3414f27-9b3d-4d63-9e7c-6a12f46d90d1 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] No waiting events found dispatching network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:32:55 user nova-compute[80928]: WARNING nova.compute.manager [req-f5f2798b-040f-431f-b1dd-ceef273956f4 req-c3414f27-9b3d-4d63-9e7c-6a12f46d90d1 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received unexpected event network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 for instance with vm_state building and task_state spawning.
Nov 16 05:32:55 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:32:55 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Instance spawned successfully.
Nov 16 05:32:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:32:55 user nova-compute[80928]: INFO nova.compute.manager [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 16 05:32:55 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:32:55 user nova-compute[80928]: INFO nova.compute.manager [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Took 6.70 seconds to build instance.
Nov 16 05:32:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2c85a3f3-6e6e-4306-b069-1793b93d0215 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.793s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "1d95a79b-847f-4eba-a096-65c834f94a40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:32:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:56 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:32:56 user nova-compute[80928]: INFO nova.compute.claims [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Claim successful on node user
Nov 16 05:32:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:32:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:32:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:32:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-5687e588-1245-42a9-b2d8-306c3c6bf8c5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-5687e588-1245-42a9-b2d8-306c3c6bf8c5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:56 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.network.neutron [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:32:57 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.policy [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '505358920a9e43c59cf29b85ffbccb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdd13a65f44182a910ecf45bf27116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Updating instance_info_cache with network_info: [{"id": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "address": "fa:16:3e:41:e0:38", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce19f2d-3f", "ovs_interfaceid": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:32:57 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Creating image(s)
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "/opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "/opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-5687e588-1245-42a9-b2d8-306c3c6bf8c5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.212s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.240s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk 1073741824" returned: 0 in 0.073s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Successfully created port: 3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.246s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-aa279a0b-27b3-4319-8df6-0b1434c467c5 req-88dc51af-3f09-4ea8-8f8c-1a1196b728f5 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Received event network-changed-ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-aa279a0b-27b3-4319-8df6-0b1434c467c5 req-88dc51af-3f09-4ea8-8f8c-1a1196b728f5 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Refreshing instance network info cache due to event network-changed-ca6d6935-11fe-45a3-913f-eba95bb46979. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa279a0b-27b3-4319-8df6-0b1434c467c5 req-88dc51af-3f09-4ea8-8f8c-1a1196b728f5 service nova] Acquiring lock "refresh_cache-fcdb0315-072c-431b-9583-400e51041f49" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa279a0b-27b3-4319-8df6-0b1434c467c5 req-88dc51af-3f09-4ea8-8f8c-1a1196b728f5 service nova] Acquired lock "refresh_cache-fcdb0315-072c-431b-9583-400e51041f49" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.network.neutron [req-aa279a0b-27b3-4319-8df6-0b1434c467c5 req-88dc51af-3f09-4ea8-8f8c-1a1196b728f5 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Refreshing network info cache for port ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Cannot resize image /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Ensure instance console log exists: /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "fcdb0315-072c-431b-9583-400e51041f49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "fcdb0315-072c-431b-9583-400e51041f49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "fcdb0315-072c-431b-9583-400e51041f49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "fcdb0315-072c-431b-9583-400e51041f49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "fcdb0315-072c-431b-9583-400e51041f49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:32:58 user nova-compute[80928]: INFO nova.compute.manager [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Terminating instance
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Successfully updated port: 3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquired lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.network.neutron [req-aa279a0b-27b3-4319-8df6-0b1434c467c5 req-88dc51af-3f09-4ea8-8f8c-1a1196b728f5 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Updated VIF entry in instance network info cache for port ca6d6935-11fe-45a3-913f-eba95bb46979. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG nova.network.neutron [req-aa279a0b-27b3-4319-8df6-0b1434c467c5 req-88dc51af-3f09-4ea8-8f8c-1a1196b728f5 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Updating instance_info_cache with network_info: [{"id": "ca6d6935-11fe-45a3-913f-eba95bb46979", "address": "fa:16:3e:74:a3:c2", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6d6935-11", "ovs_interfaceid": "ca6d6935-11fe-45a3-913f-eba95bb46979", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-8a8bbda4-22b3-41d8-8b18-a979603f28ba req-e59b115d-2948-4268-a9e8-1d02ddaa3701 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-changed-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-8a8bbda4-22b3-41d8-8b18-a979603f28ba req-e59b115d-2948-4268-a9e8-1d02ddaa3701 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Refreshing instance network info cache due to event network-changed-3fd63666-004c-416e-877a-dbc4fcbe6fcd. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8a8bbda4-22b3-41d8-8b18-a979603f28ba req-e59b115d-2948-4268-a9e8-1d02ddaa3701 service nova] Acquiring lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa279a0b-27b3-4319-8df6-0b1434c467c5 req-88dc51af-3f09-4ea8-8f8c-1a1196b728f5 service nova] Releasing lock "refresh_cache-fcdb0315-072c-431b-9583-400e51041f49" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updating instance_info_cache with network_info: [{"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Releasing lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Instance network_info: |[{"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8a8bbda4-22b3-41d8-8b18-a979603f28ba req-e59b115d-2948-4268-a9e8-1d02ddaa3701 service nova] Acquired lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.network.neutron [req-8a8bbda4-22b3-41d8-8b18-a979603f28ba req-e59b115d-2948-4268-a9e8-1d02ddaa3701 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Refreshing network info cache for port 3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Start _get_guest_xml network_info=[{"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:32:59 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:32:59 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-829617757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-829617757',id=18,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBVIcuLIoeyJUCfApF95eDV2Wo0tU7REYxuVWr/fb1xvg+3fDUjymswWM+MIn+/kdz99QUdgvxCYkYWnfYA61PMztbyoXcQ7rWJGut8ydbk3LZT4zuI8EfyKedqfH+Inw==',key_name='tempest-keypair-1667699851',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9efdd13a65f44182a910ecf45bf27116',ramdisk_id='',reservation_id='r-y0372kuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-658694431',owner_user_name='tempest-AttachVolumeShelveTestJSON-658694431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:32:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='505358920a9e43c59cf29b85ffbccb95',uuid=1d95a79b-847f-4eba-a096-65c834f94a40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converting VIF {"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.objects.instance [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d95a79b-847f-4eba-a096-65c834f94a40 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:32:59 user nova-compute[80928]:   <uuid>1d95a79b-847f-4eba-a096-65c834f94a40</uuid>
Nov 16 05:32:59 user nova-compute[80928]:   <name>instance-00000012</name>
Nov 16 05:32:59 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:32:59 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:32:59 user nova-compute[80928]:   <metadata>
Nov 16 05:32:59 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:32:59 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:32:59 user nova-compute[80928]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-829617757</nova:name>
Nov 16 05:32:59 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:32:59</nova:creationTime>
Nov 16 05:32:59 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:32:59 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:32:59 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:32:59 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:32:59 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:32:59 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:32:59 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:32:59 user nova-compute[80928]:       <nova:owner>
Nov 16 05:32:59 user nova-compute[80928]:         <nova:user uuid="505358920a9e43c59cf29b85ffbccb95">tempest-AttachVolumeShelveTestJSON-658694431-project-member</nova:user>
Nov 16 05:32:59 user nova-compute[80928]:         <nova:project uuid="9efdd13a65f44182a910ecf45bf27116">tempest-AttachVolumeShelveTestJSON-658694431</nova:project>
Nov 16 05:32:59 user nova-compute[80928]:       </nova:owner>
Nov 16 05:32:59 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:32:59 user nova-compute[80928]:       <nova:ports>
Nov 16 05:32:59 user nova-compute[80928]:         <nova:port uuid="3fd63666-004c-416e-877a-dbc4fcbe6fcd">
Nov 16 05:32:59 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:32:59 user nova-compute[80928]:         </nova:port>
Nov 16 05:32:59 user nova-compute[80928]:       </nova:ports>
Nov 16 05:32:59 user nova-compute[80928]:     </nova:instance>
Nov 16 05:32:59 user nova-compute[80928]:   </metadata>
Nov 16 05:32:59 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:32:59 user nova-compute[80928]:     <system>
Nov 16 05:32:59 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:32:59 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:32:59 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:32:59 user nova-compute[80928]:       <entry name="serial">1d95a79b-847f-4eba-a096-65c834f94a40</entry>
Nov 16 05:32:59 user nova-compute[80928]:       <entry name="uuid">1d95a79b-847f-4eba-a096-65c834f94a40</entry>
Nov 16 05:32:59 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:32:59 user nova-compute[80928]:     </system>
Nov 16 05:32:59 user nova-compute[80928]:   </sysinfo>
Nov 16 05:32:59 user nova-compute[80928]:   <os>
Nov 16 05:32:59 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:32:59 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:32:59 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:32:59 user nova-compute[80928]:   </os>
Nov 16 05:32:59 user nova-compute[80928]:   <features>
Nov 16 05:32:59 user nova-compute[80928]:     <acpi/>
Nov 16 05:32:59 user nova-compute[80928]:     <apic/>
Nov 16 05:32:59 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:32:59 user nova-compute[80928]:   </features>
Nov 16 05:32:59 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:32:59 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:32:59 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:32:59 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:32:59 user nova-compute[80928]:   </clock>
Nov 16 05:32:59 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:32:59 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:32:59 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:32:59 user nova-compute[80928]:   </cpu>
Nov 16 05:32:59 user nova-compute[80928]:   <devices>
Nov 16 05:32:59 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:32:59 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:32:59 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk"/>
Nov 16 05:32:59 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:32:59 user nova-compute[80928]:     </disk>
Nov 16 05:32:59 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:32:59 user nova-compute[80928]:       <mac address="fa:16:3e:cb:36:8f"/>
Nov 16 05:32:59 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:32:59 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:32:59 user nova-compute[80928]:       <target dev="tap3fd63666-00"/>
Nov 16 05:32:59 user nova-compute[80928]:     </interface>
Nov 16 05:32:59 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:32:59 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/console.log" append="off"/>
Nov 16 05:32:59 user nova-compute[80928]:     </serial>
Nov 16 05:32:59 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:32:59 user nova-compute[80928]:     <video>
Nov 16 05:32:59 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:32:59 user nova-compute[80928]:     </video>
Nov 16 05:32:59 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:32:59 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:32:59 user nova-compute[80928]:     </rng>
Nov 16 05:32:59 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:32:59 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:32:59 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:32:59 user nova-compute[80928]:     </memballoon>
Nov 16 05:32:59 user nova-compute[80928]:   </devices>
Nov 16 05:32:59 user nova-compute[80928]: </domain>
Nov 16 05:32:59 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-829617757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-829617757',id=18,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBVIcuLIoeyJUCfApF95eDV2Wo0tU7REYxuVWr/fb1xvg+3fDUjymswWM+MIn+/kdz99QUdgvxCYkYWnfYA61PMztbyoXcQ7rWJGut8ydbk3LZT4zuI8EfyKedqfH+Inw==',key_name='tempest-keypair-1667699851',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9efdd13a65f44182a910ecf45bf27116',ramdisk_id='',reservation_id='r-y0372kuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-658694431',owner_user_name='tempest-AttachVolumeShelveTestJSON-658694431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:32:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='505358920a9e43c59cf29b85ffbccb95',uuid=1d95a79b-847f-4eba-a096-65c834f94a40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converting VIF {"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG os_vif [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcebc1d3-4c78-5449-9409-8260166fd7a1', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:59 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: fcdb0315-072c-431b-9583-400e51041f49] Instance destroyed successfully.
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.objects.instance [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'resources' on Instance uuid fcdb0315-072c-431b-9583-400e51041f49 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fd63666-00, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fd63666-00, col_values=(('qos', UUID('77f6082b-2e70-421d-938d-8b7a46dda2a9')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fd63666-00, col_values=(('external_ids', {'iface-id': '3fd63666-004c-416e-877a-dbc4fcbe6fcd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:36:8f', 'vm-uuid': '1d95a79b-847f-4eba-a096-65c834f94a40'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-711591726',display_name='tempest-AttachVolumeNegativeTest-server-711591726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-711591726',id=13,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0dFzAu5lolz9NMDNDSzjrqXiKlYM5FlBqmuUAqTzgtGswx4bUaWbOFHRJFd0LyBDpitYUAAvyZto/7+aSJtdPzTxIrpp9izbGRmpmVK1roVvOgRs1sk5ZamvAUFk+lfg==',key_name='tempest-keypair-595545743',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:31:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f585dcb9e6cb432a9b04526ebc30e9d8',ramdisk_id='',reservation_id='r-l0h4se5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-155531213',owner_user_name='tempest-AttachVolumeNegativeTest-155531213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952a7ea7e63649259b0b1e0df40c97d0',uuid=fcdb0315-072c-431b-9583-400e51041f49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca6d6935-11fe-45a3-913f-eba95bb46979", "address": "fa:16:3e:74:a3:c2", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6d6935-11", "ovs_interfaceid": "ca6d6935-11fe-45a3-913f-eba95bb46979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converting VIF {"id": "ca6d6935-11fe-45a3-913f-eba95bb46979", "address": "fa:16:3e:74:a3:c2", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6d6935-11", "ovs_interfaceid": "ca6d6935-11fe-45a3-913f-eba95bb46979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a3:c2,bridge_name='br-int',has_traffic_filtering=True,id=ca6d6935-11fe-45a3-913f-eba95bb46979,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6d6935-11') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG os_vif [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a3:c2,bridge_name='br-int',has_traffic_filtering=True,id=ca6d6935-11fe-45a3-913f-eba95bb46979,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6d6935-11') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: INFO os_vif [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00')
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca6d6935-11, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=134ea37f-9450-42d4-9ae2-793777bdc083) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:32:59 user nova-compute[80928]: INFO os_vif [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a3:c2,bridge_name='br-int',has_traffic_filtering=True,id=ca6d6935-11fe-45a3-913f-eba95bb46979,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6d6935-11')
Nov 16 05:32:59 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Deleting instance files /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49_del
Nov 16 05:32:59 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Deletion of /opt/stack/data/nova/instances/fcdb0315-072c-431b-9583-400e51041f49_del complete
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] No VIF found with MAC fa:16:3e:cb:36:8f, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:32:59 user nova-compute[80928]: INFO nova.compute.manager [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: fcdb0315-072c-431b-9583-400e51041f49] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 16 05:32:59 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: fcdb0315-072c-431b-9583-400e51041f49] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:32:59 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: fcdb0315-072c-431b-9583-400e51041f49] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:00 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Error from libvirt while getting description of instance-0000000d: [Error Code 42] Domain not found: no domain with matching uuid 'fcdb0315-072c-431b-9583-400e51041f49' (instance-0000000d): libvirt.libvirtError: Domain not found: no domain with matching uuid 'fcdb0315-072c-431b-9583-400e51041f49' (instance-0000000d)
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG nova.network.neutron [req-8a8bbda4-22b3-41d8-8b18-a979603f28ba req-e59b115d-2948-4268-a9e8-1d02ddaa3701 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updated VIF entry in instance network info cache for port 3fd63666-004c-416e-877a-dbc4fcbe6fcd. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG nova.network.neutron [req-8a8bbda4-22b3-41d8-8b18-a979603f28ba req-e59b115d-2948-4268-a9e8-1d02ddaa3701 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updating instance_info_cache with network_info: [{"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8a8bbda4-22b3-41d8-8b18-a979603f28ba req-e59b115d-2948-4268-a9e8-1d02ddaa3701 service nova] Releasing lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: fcdb0315-072c-431b-9583-400e51041f49] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-5d0d154e-ade2-4c76-9340-5b1a80099c48 req-10cfb06f-c987-4283-9a37-954b94b335d8 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Received event network-vif-deleted-ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:33:00 user nova-compute[80928]: INFO nova.compute.manager [req-5d0d154e-ade2-4c76-9340-5b1a80099c48 req-10cfb06f-c987-4283-9a37-954b94b335d8 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Neutron deleted interface ca6d6935-11fe-45a3-913f-eba95bb46979; detaching it from the instance and deleting it from the info cache
Nov 16 05:33:00 user nova-compute[80928]: DEBUG nova.network.neutron [req-5d0d154e-ade2-4c76-9340-5b1a80099c48 req-10cfb06f-c987-4283-9a37-954b94b335d8 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:33:00 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: fcdb0315-072c-431b-9583-400e51041f49] Took 0.82 seconds to deallocate network for instance.
Nov 16 05:33:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-5d0d154e-ade2-4c76-9340-5b1a80099c48 req-10cfb06f-c987-4283-9a37-954b94b335d8 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Detach interface failed, port_id=ca6d6935-11fe-45a3-913f-eba95bb46979, reason: Instance fcdb0315-072c-431b-9583-400e51041f49 could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe95bee1-bf88-4794-a531-a6d1b24e22c4 req-07dc283f-a25c-4920-8fe9-ac9fd2a0a3b3 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Received event network-vif-unplugged-ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe95bee1-bf88-4794-a531-a6d1b24e22c4 req-07dc283f-a25c-4920-8fe9-ac9fd2a0a3b3 service nova] Acquiring lock "fcdb0315-072c-431b-9583-400e51041f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe95bee1-bf88-4794-a531-a6d1b24e22c4 req-07dc283f-a25c-4920-8fe9-ac9fd2a0a3b3 service nova] Lock "fcdb0315-072c-431b-9583-400e51041f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe95bee1-bf88-4794-a531-a6d1b24e22c4 req-07dc283f-a25c-4920-8fe9-ac9fd2a0a3b3 service nova] Lock "fcdb0315-072c-431b-9583-400e51041f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe95bee1-bf88-4794-a531-a6d1b24e22c4 req-07dc283f-a25c-4920-8fe9-ac9fd2a0a3b3 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] No waiting events found dispatching network-vif-unplugged-ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:33:01 user nova-compute[80928]: WARNING nova.compute.manager [req-fe95bee1-bf88-4794-a531-a6d1b24e22c4 req-07dc283f-a25c-4920-8fe9-ac9fd2a0a3b3 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Received unexpected event network-vif-unplugged-ca6d6935-11fe-45a3-913f-eba95bb46979 for instance with vm_state deleted and task_state None.
Nov 16 05:33:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe95bee1-bf88-4794-a531-a6d1b24e22c4 req-07dc283f-a25c-4920-8fe9-ac9fd2a0a3b3 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Received event network-vif-plugged-ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe95bee1-bf88-4794-a531-a6d1b24e22c4 req-07dc283f-a25c-4920-8fe9-ac9fd2a0a3b3 service nova] Acquiring lock "fcdb0315-072c-431b-9583-400e51041f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe95bee1-bf88-4794-a531-a6d1b24e22c4 req-07dc283f-a25c-4920-8fe9-ac9fd2a0a3b3 service nova] Lock "fcdb0315-072c-431b-9583-400e51041f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe95bee1-bf88-4794-a531-a6d1b24e22c4 req-07dc283f-a25c-4920-8fe9-ac9fd2a0a3b3 service nova] Lock "fcdb0315-072c-431b-9583-400e51041f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe95bee1-bf88-4794-a531-a6d1b24e22c4 req-07dc283f-a25c-4920-8fe9-ac9fd2a0a3b3 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] No waiting events found dispatching network-vif-plugged-ca6d6935-11fe-45a3-913f-eba95bb46979 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:33:01 user nova-compute[80928]: WARNING nova.compute.manager [req-fe95bee1-bf88-4794-a531-a6d1b24e22c4 req-07dc283f-a25c-4920-8fe9-ac9fd2a0a3b3 service nova] [instance: fcdb0315-072c-431b-9583-400e51041f49] Received unexpected event network-vif-plugged-ca6d6935-11fe-45a3-913f-eba95bb46979 for instance with vm_state deleted and task_state None.
Nov 16 05:33:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.547s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:02 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Deleted allocations for instance fcdb0315-072c-431b-9583-400e51041f49
Nov 16 05:33:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:02 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:33:02 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7792MB free_disk=25.649818420410156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8933e646-bef8-4d9d-8073-55263c21e9f5 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "fcdb0315-072c-431b-9583-400e51041f49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.355s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5d03bda0-20b8-497a-a87b-faee21624468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5687e588-1245-42a9-b2d8-306c3c6bf8c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance d5e15464-01b2-4ad5-85e2-deeca243ceae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance d9495878-bdc8-4448-9a96-a93168cca9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 859f06da-737e-40c3-9e85-2fd33052a9ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 1d95a79b-847f-4eba-a096-65c834f94a40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:33:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-b9b0f10c-f7ff-4901-b1f0-9107a16704a9 req-f843297e-8c51-4d18-ab12-e9d2b64a884c service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b9b0f10c-f7ff-4901-b1f0-9107a16704a9 req-f843297e-8c51-4d18-ab12-e9d2b64a884c service nova] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b9b0f10c-f7ff-4901-b1f0-9107a16704a9 req-f843297e-8c51-4d18-ab12-e9d2b64a884c service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b9b0f10c-f7ff-4901-b1f0-9107a16704a9 req-f843297e-8c51-4d18-ab12-e9d2b64a884c service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-b9b0f10c-f7ff-4901-b1f0-9107a16704a9 req-f843297e-8c51-4d18-ab12-e9d2b64a884c service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] No waiting events found dispatching network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:33:03 user nova-compute[80928]: WARNING nova.compute.manager [req-b9b0f10c-f7ff-4901-b1f0-9107a16704a9 req-f843297e-8c51-4d18-ab12-e9d2b64a884c service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received unexpected event network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd for instance with vm_state building and task_state spawning.
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-b9b0f10c-f7ff-4901-b1f0-9107a16704a9 req-f843297e-8c51-4d18-ab12-e9d2b64a884c service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b9b0f10c-f7ff-4901-b1f0-9107a16704a9 req-f843297e-8c51-4d18-ab12-e9d2b64a884c service nova] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b9b0f10c-f7ff-4901-b1f0-9107a16704a9 req-f843297e-8c51-4d18-ab12-e9d2b64a884c service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b9b0f10c-f7ff-4901-b1f0-9107a16704a9 req-f843297e-8c51-4d18-ab12-e9d2b64a884c service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-b9b0f10c-f7ff-4901-b1f0-9107a16704a9 req-f843297e-8c51-4d18-ab12-e9d2b64a884c service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] No waiting events found dispatching network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:33:03 user nova-compute[80928]: WARNING nova.compute.manager [req-b9b0f10c-f7ff-4901-b1f0-9107a16704a9 req-f843297e-8c51-4d18-ab12-e9d2b64a884c service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received unexpected event network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd for instance with vm_state building and task_state spawning.
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:33:03 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Instance spawned successfully.
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:33:03 user nova-compute[80928]: INFO nova.compute.manager [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Took 6.37 seconds to spawn the instance on the hypervisor.
Nov 16 05:33:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:33:03 user nova-compute[80928]: INFO nova.compute.manager [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Took 7.34 seconds to build instance.
Nov 16 05:33:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5bfbc7-cd5e-472a-adb5-63809e0b2063 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "1d95a79b-847f-4eba-a096-65c834f94a40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.441s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:33:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:15 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:33:15 user nova-compute[80928]: INFO nova.compute.claims [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Claim successful on node user
Nov 16 05:33:15 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:33:15 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:33:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:33:16 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:33:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG nova.policy [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea9806dcc82048899583dd9f738c109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8884142201406a89f46fdfcfb7cb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:33:16 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Creating image(s)
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "/opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "/opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "/opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk 1073741824" returned: 0 in 0.061s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Successfully created port: 42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:33:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Cannot resize image /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Ensure instance console log exists: /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Successfully updated port: 42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquired lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.compute.manager [req-b6cbb490-48a0-4b0f-b541-91b4fd66d83c req-56f63236-a835-466b-826e-7e3d7fee2bf6 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-changed-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.compute.manager [req-b6cbb490-48a0-4b0f-b541-91b4fd66d83c req-56f63236-a835-466b-826e-7e3d7fee2bf6 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Refreshing instance network info cache due to event network-changed-42b5d66c-7f70-41b3-b29c-58333c62c7f2. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6cbb490-48a0-4b0f-b541-91b4fd66d83c req-56f63236-a835-466b-826e-7e3d7fee2bf6 service nova] Acquiring lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating instance_info_cache with network_info: [{"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Releasing lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Instance network_info: |[{"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6cbb490-48a0-4b0f-b541-91b4fd66d83c req-56f63236-a835-466b-826e-7e3d7fee2bf6 service nova] Acquired lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.network.neutron [req-b6cbb490-48a0-4b0f-b541-91b4fd66d83c req-56f63236-a835-466b-826e-7e3d7fee2bf6 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Refreshing network info cache for port 42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Start _get_guest_xml network_info=[{"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:33:17 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:33:17 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:33:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1720886813',display_name='tempest-ServerActionsTestOtherB-server-1720886813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1720886813',id=19,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9liT9/8OcIK+JyCDfTMk3trFPyZpf/7B0mBbUikRHMSTPB1lcjCLvTtHnBj5VmxOBF7smgL7oBOajybgsCgVmXQlH849r5LdVXz3wtlHkH2OG/ZZJDnudNBjLF68+HYQ==',key_name='tempest-keypair-454342651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a8884142201406a89f46fdfcfb7cb7e',ramdisk_id='',reservation_id='r-0aqy2onj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1064773206',owner_user_name='tempest-ServerActionsTestOtherB-1064773206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:33:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea9806dcc82048899583dd9f738c109d',uuid=431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converting VIF {"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.objects.instance [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lazy-loading 'pci_devices' on Instance uuid 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:33:17 user nova-compute[80928]:   <uuid>431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc</uuid>
Nov 16 05:33:17 user nova-compute[80928]:   <name>instance-00000013</name>
Nov 16 05:33:17 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:33:17 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:33:17 user nova-compute[80928]:   <metadata>
Nov 16 05:33:17 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:33:17 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:33:17 user nova-compute[80928]:       <nova:name>tempest-ServerActionsTestOtherB-server-1720886813</nova:name>
Nov 16 05:33:17 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:33:17</nova:creationTime>
Nov 16 05:33:17 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:33:17 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:33:17 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:33:17 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:33:17 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:33:17 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:33:17 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:33:17 user nova-compute[80928]:       <nova:owner>
Nov 16 05:33:17 user nova-compute[80928]:         <nova:user uuid="ea9806dcc82048899583dd9f738c109d">tempest-ServerActionsTestOtherB-1064773206-project-member</nova:user>
Nov 16 05:33:17 user nova-compute[80928]:         <nova:project uuid="1a8884142201406a89f46fdfcfb7cb7e">tempest-ServerActionsTestOtherB-1064773206</nova:project>
Nov 16 05:33:17 user nova-compute[80928]:       </nova:owner>
Nov 16 05:33:17 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:33:17 user nova-compute[80928]:       <nova:ports>
Nov 16 05:33:17 user nova-compute[80928]:         <nova:port uuid="42b5d66c-7f70-41b3-b29c-58333c62c7f2">
Nov 16 05:33:17 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 05:33:17 user nova-compute[80928]:         </nova:port>
Nov 16 05:33:17 user nova-compute[80928]:       </nova:ports>
Nov 16 05:33:17 user nova-compute[80928]:     </nova:instance>
Nov 16 05:33:17 user nova-compute[80928]:   </metadata>
Nov 16 05:33:17 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:33:17 user nova-compute[80928]:     <system>
Nov 16 05:33:17 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:33:17 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:33:17 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:33:17 user nova-compute[80928]:       <entry name="serial">431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc</entry>
Nov 16 05:33:17 user nova-compute[80928]:       <entry name="uuid">431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc</entry>
Nov 16 05:33:17 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:33:17 user nova-compute[80928]:     </system>
Nov 16 05:33:17 user nova-compute[80928]:   </sysinfo>
Nov 16 05:33:17 user nova-compute[80928]:   <os>
Nov 16 05:33:17 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:33:17 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:33:17 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:33:17 user nova-compute[80928]:   </os>
Nov 16 05:33:17 user nova-compute[80928]:   <features>
Nov 16 05:33:17 user nova-compute[80928]:     <acpi/>
Nov 16 05:33:17 user nova-compute[80928]:     <apic/>
Nov 16 05:33:17 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:33:17 user nova-compute[80928]:   </features>
Nov 16 05:33:17 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:33:17 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:33:17 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:33:17 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:33:17 user nova-compute[80928]:   </clock>
Nov 16 05:33:17 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:33:17 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:33:17 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:33:17 user nova-compute[80928]:   </cpu>
Nov 16 05:33:17 user nova-compute[80928]:   <devices>
Nov 16 05:33:17 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:33:17 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:33:17 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk"/>
Nov 16 05:33:17 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:33:17 user nova-compute[80928]:     </disk>
Nov 16 05:33:17 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:33:17 user nova-compute[80928]:       <mac address="fa:16:3e:58:5c:e5"/>
Nov 16 05:33:17 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:33:17 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:33:17 user nova-compute[80928]:       <target dev="tap42b5d66c-7f"/>
Nov 16 05:33:17 user nova-compute[80928]:     </interface>
Nov 16 05:33:17 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:33:17 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/console.log" append="off"/>
Nov 16 05:33:17 user nova-compute[80928]:     </serial>
Nov 16 05:33:17 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:33:17 user nova-compute[80928]:     <video>
Nov 16 05:33:17 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:33:17 user nova-compute[80928]:     </video>
Nov 16 05:33:17 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:33:17 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:33:17 user nova-compute[80928]:     </rng>
Nov 16 05:33:17 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:33:17 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:33:17 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:33:17 user nova-compute[80928]:     </memballoon>
Nov 16 05:33:17 user nova-compute[80928]:   </devices>
Nov 16 05:33:17 user nova-compute[80928]: </domain>
Nov 16 05:33:17 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:33:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1720886813',display_name='tempest-ServerActionsTestOtherB-server-1720886813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1720886813',id=19,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9liT9/8OcIK+JyCDfTMk3trFPyZpf/7B0mBbUikRHMSTPB1lcjCLvTtHnBj5VmxOBF7smgL7oBOajybgsCgVmXQlH849r5LdVXz3wtlHkH2OG/ZZJDnudNBjLF68+HYQ==',key_name='tempest-keypair-454342651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a8884142201406a89f46fdfcfb7cb7e',ramdisk_id='',reservation_id='r-0aqy2onj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1064773206',owner_user_name='tempest-ServerActionsTestOtherB-1064773206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:33:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea9806dcc82048899583dd9f738c109d',uuid=431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converting VIF {"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG os_vif [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e1511b2-4dd6-5162-9e3f-54d9378556da', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42b5d66c-7f, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42b5d66c-7f, col_values=(('qos', UUID('8448483a-8ebe-4799-8e45-7d55ae773ab5')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42b5d66c-7f, col_values=(('external_ids', {'iface-id': '42b5d66c-7f70-41b3-b29c-58333c62c7f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:5c:e5', 'vm-uuid': '431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:17 user nova-compute[80928]: INFO os_vif [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f')
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:33:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] No VIF found with MAC fa:16:3e:58:5c:e5, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:33:18 user nova-compute[80928]: DEBUG nova.network.neutron [req-b6cbb490-48a0-4b0f-b541-91b4fd66d83c req-56f63236-a835-466b-826e-7e3d7fee2bf6 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updated VIF entry in instance network info cache for port 42b5d66c-7f70-41b3-b29c-58333c62c7f2. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:33:18 user nova-compute[80928]: DEBUG nova.network.neutron [req-b6cbb490-48a0-4b0f-b541-91b4fd66d83c req-56f63236-a835-466b-826e-7e3d7fee2bf6 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating instance_info_cache with network_info: [{"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:33:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6cbb490-48a0-4b0f-b541-91b4fd66d83c req-56f63236-a835-466b-826e-7e3d7fee2bf6 service nova] Releasing lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:33:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:19 user nova-compute[80928]: DEBUG nova.compute.manager [req-9a92d695-e8a8-4a0c-9230-14ff26900ff3 req-200a2b0c-6d59-4df5-930d-3991196f70a9 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:33:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9a92d695-e8a8-4a0c-9230-14ff26900ff3 req-200a2b0c-6d59-4df5-930d-3991196f70a9 service nova] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9a92d695-e8a8-4a0c-9230-14ff26900ff3 req-200a2b0c-6d59-4df5-930d-3991196f70a9 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9a92d695-e8a8-4a0c-9230-14ff26900ff3 req-200a2b0c-6d59-4df5-930d-3991196f70a9 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:19 user nova-compute[80928]: DEBUG nova.compute.manager [req-9a92d695-e8a8-4a0c-9230-14ff26900ff3 req-200a2b0c-6d59-4df5-930d-3991196f70a9 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] No waiting events found dispatching network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:33:19 user nova-compute[80928]: WARNING nova.compute.manager [req-9a92d695-e8a8-4a0c-9230-14ff26900ff3 req-200a2b0c-6d59-4df5-930d-3991196f70a9 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received unexpected event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 for instance with vm_state building and task_state spawning.
Nov 16 05:33:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:33:21 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Instance spawned successfully.
Nov 16 05:33:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:33:21 user nova-compute[80928]: INFO nova.compute.manager [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 16 05:33:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:33:21 user nova-compute[80928]: INFO nova.compute.manager [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Took 5.92 seconds to build instance.
Nov 16 05:33:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-738aa89f-a308-46c4-b18e-5fa28e0a92ad tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.044s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG nova.compute.manager [req-9184926d-ce42-43dd-9dcb-d63de3fe23f7 req-a8341277-5d15-46ed-9858-85d62e119d69 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9184926d-ce42-43dd-9dcb-d63de3fe23f7 req-a8341277-5d15-46ed-9858-85d62e119d69 service nova] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9184926d-ce42-43dd-9dcb-d63de3fe23f7 req-a8341277-5d15-46ed-9858-85d62e119d69 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9184926d-ce42-43dd-9dcb-d63de3fe23f7 req-a8341277-5d15-46ed-9858-85d62e119d69 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:21 user nova-compute[80928]: DEBUG nova.compute.manager [req-9184926d-ce42-43dd-9dcb-d63de3fe23f7 req-a8341277-5d15-46ed-9858-85d62e119d69 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] No waiting events found dispatching network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:33:21 user nova-compute[80928]: WARNING nova.compute.manager [req-9184926d-ce42-43dd-9dcb-d63de3fe23f7 req-a8341277-5d15-46ed-9858-85d62e119d69 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received unexpected event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 for instance with vm_state active and task_state None.
Nov 16 05:33:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:48 user nova-compute[80928]: INFO nova.compute.manager [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Rescuing
Nov 16 05:33:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:33:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquired lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:33:48 user nova-compute[80928]: DEBUG nova.network.neutron [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:33:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:49 user nova-compute[80928]: DEBUG nova.network.neutron [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Updating instance_info_cache with network_info: [{"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:33:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Releasing lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:33:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:50 user nova-compute[80928]: INFO nova.compute.manager [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Detaching volume a647a8dd-46fe-40a4-9628-79364cacf96a
Nov 16 05:33:50 user nova-compute[80928]: INFO nova.virt.block_device [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Attempting to driver detach volume a647a8dd-46fe-40a4-9628-79364cacf96a from mountpoint /dev/vdb
Nov 16 05:33:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Instance destroyed successfully.
Nov 16 05:33:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Attempting a stable device rescue
Nov 16 05:33:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Attempting to detach device vdb from instance 5687e588-1245-42a9-b2d8-306c3c6bf8c5 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:33:50 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:33:50 user nova-compute[80928]:   <source dev="/dev/sdf"/>
Nov 16 05:33:50 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:33:50 user nova-compute[80928]:   <serial>a647a8dd-46fe-40a4-9628-79364cacf96a</serial>
Nov 16 05:33:50 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:33:50 user nova-compute[80928]: </disk>
Nov 16 05:33:50 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:33:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully detached device vdb from instance 5687e588-1245-42a9-b2d8-306c3c6bf8c5 from the persistent domain config.
Nov 16 05:33:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5687e588-1245-42a9-b2d8-306c3c6bf8c5 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:33:50 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:33:50 user nova-compute[80928]:   <source dev="/dev/sdf"/>
Nov 16 05:33:50 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:33:50 user nova-compute[80928]:   <serial>a647a8dd-46fe-40a4-9628-79364cacf96a</serial>
Nov 16 05:33:50 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:33:50 user nova-compute[80928]: </disk>
Nov 16 05:33:50 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=80928) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Instance directory exists: not creating {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 05:33:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Creating image(s)
Nov 16 05:33:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "/opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "/opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "/opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG nova.objects.instance [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'trusted_certs' on Instance uuid a39e1ed9-2651-4de2-8979-c030b02b0ee1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "ab391f7fd5f55f0c477a54619642e2ec64c0797b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "ab391f7fd5f55f0c477a54619642e2ec64c0797b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b.part --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5687e588-1245-42a9-b2d8-306c3c6bf8c5 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:33:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b.part --force-share --output=json" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:51 user nova-compute[80928]: DEBUG nova.virt.images [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] 973fad06-b44a-44fa-9603-ac2d4ce1e0a8 was qcow2, converting to raw {{(pid=80928) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 05:33:51 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:33:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b.part /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b.converted {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b.part /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b.converted" returned: 0 in 0.319s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b.converted --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "ab391f7fd5f55f0c477a54619642e2ec64c0797b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.633s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "ab391f7fd5f55f0c477a54619642e2ec64c0797b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "ab391f7fd5f55f0c477a54619642e2ec64c0797b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b,backing_fmt=raw /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.rescue {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b,backing_fmt=raw /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.rescue" returned: 0 in 0.045s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "ab391f7fd5f55f0c477a54619642e2ec64c0797b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.objects.instance [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'migration_context' on Instance uuid a39e1ed9-2651-4de2-8979-c030b02b0ee1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.objects.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Object Instance<a39e1ed9-2651-4de2-8979-c030b02b0ee1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Start _get_guest_xml network_info=[{"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "vif_mac": "fa:16:3e:e5:51:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '973fad06-b44a-44fa-9603-ac2d4ce1e0a8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPXoqICg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a39e1ed9-2651-4de2-8979-c030b02b0ee1', 'attached_at': '', 'detached_at': '', 'volume_id': '23705545-4fdf-464f-8bd3-064fcf28ed81', 'serial': '23705545-4fdf-464f-8bd3-064fcf28ed81'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '98b4a67e-7312-4a66-858f-1891e1f669c0', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.objects.instance [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'resources' on Instance uuid a39e1ed9-2651-4de2-8979-c030b02b0ee1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.objects.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Object Instance<a39e1ed9-2651-4de2-8979-c030b02b0ee1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.objects.instance [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'numa_topology' on Instance uuid a39e1ed9-2651-4de2-8979-c030b02b0ee1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.objects.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Object Instance<a39e1ed9-2651-4de2-8979-c030b02b0ee1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:33:52 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:33:52 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.objects.instance [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'vcpu_model' on Instance uuid a39e1ed9-2651-4de2-8979-c030b02b0ee1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.objects.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Object Instance<a39e1ed9-2651-4de2-8979-c030b02b0ee1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPXoqICg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:33:52 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:33:52 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:33:52 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b622488-aa98-49df-b961-4a6aab983fcf]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JPXoqICg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 05:33:52 user nova-compute[80928]: node.name = iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:33:52 user nova-compute[80928]: node.tpgt = -1
Nov 16 05:33:52 user nova-compute[80928]: node.startup = automatic
Nov 16 05:33:52 user nova-compute[80928]: node.leading_login = No
Nov 16 05:33:52 user nova-compute[80928]: iface.iscsi_ifacename = default
Nov 16 05:33:52 user nova-compute[80928]: iface.net_ifacename = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.ipaddress = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.prefix_len = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.hwaddress = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.transport_name = tcp
Nov 16 05:33:52 user nova-compute[80928]: iface.initiatorname = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.state = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.vlan_id = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.vlan_priority = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.vlan_state = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.iface_num = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.mtu = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.port = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.bootproto = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.subnet_mask = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.gateway = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.dhcp_alt_client_id = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.dhcp_dns = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.dhcp_learn_iqn = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.dhcp_vendor_id_state = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.dhcp_vendor_id = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.dhcp_slp_da = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.fragmentation = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.gratuitous_arp = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.incoming_forwarding = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.tos_state = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.tos = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.ttl = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.delayed_ack = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.tcp_nagle = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.tcp_wsf_state = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.tcp_wsf = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.tcp_timer_scale = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.tcp_timestamp = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.redirect = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.def_task_mgmt_timeout = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.header_digest = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.data_digest = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.immediate_data = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.initial_r2t = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.data_seq_inorder = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.data_pdu_inorder = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.erl = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.max_receive_data_len = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.first_burst_len = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.max_outstanding_r2t = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.max_burst_len = 0
Nov 16 05:33:52 user nova-compute[80928]: iface.chap_auth = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.bidi_chap = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.strict_login_compliance = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.discovery_auth = <empty>
Nov 16 05:33:52 user nova-compute[80928]: iface.discovery_logout = <empty>
Nov 16 05:33:52 user nova-compute[80928]: node.discovery_address = <empty>
Nov 16 05:33:52 user nova-compute[80928]: node.discovery_port = 0
Nov 16 05:33:52 user nova-compute[80928]: node.discovery_type = static
Nov 16 05:33:52 user nova-compute[80928]: node.session.initial_cmdsn = 0
Nov 16 05:33:52 user nova-compute[80928]: node.session.initial_login_retry_max = 8
Nov 16 05:33:52 user nova-compute[80928]: node.session.xmit_thread_priority = -20
Nov 16 05:33:52 user nova-compute[80928]: node.session.cmds_max = 128
Nov 16 05:33:52 user nova-compute[80928]: node.session.queue_depth = 32
Nov 16 05:33:52 user nova-compute[80928]: node.session.nr_sessions = 1
Nov 16 05:33:52 user nova-compute[80928]: node.session.auth.authmethod = CHAP
Nov 16 05:33:52 user nova-compute[80928]: node.session.auth.username = JPXoqICg
Nov 16 05:33:52 user nova-compute[80928]: node.session.auth.password = ***
Nov 16 05:33:52 user nova-compute[80928]: node.session.auth.username_in = <empty>
Nov 16 05:33:52 user nova-compute[80928]: node.session.auth.password_in = <empty>
Nov 16 05:33:52 user nova-compute[80928]: node.session.auth.chap_algs = MD5
Nov 16 05:33:52 user nova-compute[80928]: node.session.timeo.replacement_timeout = 120
Nov 16 05:33:52 user nova-compute[80928]: node.session.err_timeo.abort_timeout = 15
Nov 16 05:33:52 user nova-compute[80928]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 05:33:52 user nova-compute[80928]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 05:33:52 user nova-compute[80928]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 05:33:52 user nova-compute[80928]: node.session.iscsi.FastAbort = Yes
Nov 16 05:33:52 user nova-compute[80928]: node.session.iscsi.InitialR2T = No
Nov 16 05:33:52 user nova-compute[80928]: node.session.iscsi.ImmediateData = Yes
Nov 16 05:33:52 user nova-compute[80928]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 05:33:52 user nova-compute[80928]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 05:33:52 user nova-compute[80928]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 05:33:52 user nova-compute[80928]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 05:33:52 user nova-compute[80928]: node.session.iscsi.MaxConnections = 1
Nov 16 05:33:52 user nova-compute[80928]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 05:33:52 user nova-compute[80928]: node.session.iscsi.ERL = 0
Nov 16 05:33:52 user nova-compute[80928]: node.session.scan = manual
Nov 16 05:33:52 user nova-compute[80928]: node.session.reopen_max = 0
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].address = 172.16.0.220
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].port = 3260
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].startup = manual
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].tcp.window_size = 524288
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].tcp.type_of_service = 0
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].timeo.logout_timeout = 15
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].timeo.login_timeout = 15
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].timeo.auth_timeout = 45
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].iscsi.DataDigest = None
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].iscsi.IFMarker = No
Nov 16 05:33:52 user nova-compute[80928]: node.conn[0].iscsi.OFMarker = No
Nov 16 05:33:52 user nova-compute[80928]: # END RECORD
Nov 16 05:33:52 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4133b2c2-d83e-4a68-8745-86a12f2d10b2]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf427415-5a4e-4a1a-a474-aa16ef854450]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPXoqICg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPXoqICg" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0661fd-9f9d-4127-a657-87e7e466f2a7]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JPXoqICg'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ae56da-c7d5-4a79-8732-21243cfc4e98]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5c55b6-4462-49e5-84d4-3e286886cc4c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:33:52 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:33:52 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:33:52 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:33:52 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.142s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] HCTL ('33', '0', '0', 0) found on session 14 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea24bc71-39a9-4afb-9aa9-a9793c17bd08]: (4, ('0 0 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching for a device in session 14 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPXoqICg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] <== connect_volume: return (171ms) {'type': 'block', 'scsi_wwn': '26365653965633237', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365653965633237', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:31:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-71404799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-71404799',id=14,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:32:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-l2xlwmyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:32:13Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=a39e1ed9-2651-4de2-8979-c030b02b0ee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "vif_mac": "fa:16:3e:e5:51:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "vif_mac": "fa:16:3e:e5:51:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=af4426f7-2ac8-4035-98b1-7739d2acf95b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4426f7-2a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.objects.instance [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'pci_devices' on Instance uuid a39e1ed9-2651-4de2-8979-c030b02b0ee1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.objects.base [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Object Instance<a39e1ed9-2651-4de2-8979-c030b02b0ee1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:33:52 user nova-compute[80928]:   <uuid>a39e1ed9-2651-4de2-8979-c030b02b0ee1</uuid>
Nov 16 05:33:52 user nova-compute[80928]:   <name>instance-0000000e</name>
Nov 16 05:33:52 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:33:52 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:33:52 user nova-compute[80928]:   <metadata>
Nov 16 05:33:52 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:33:52 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:33:52 user nova-compute[80928]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-71404799</nova:name>
Nov 16 05:33:52 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:33:52</nova:creationTime>
Nov 16 05:33:52 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:33:52 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:33:52 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:33:52 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:33:52 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:33:52 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:33:52 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:33:52 user nova-compute[80928]:       <nova:owner>
Nov 16 05:33:52 user nova-compute[80928]:         <nova:user uuid="3bb9af29de44488282666171f2bcad47">tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member</nova:user>
Nov 16 05:33:52 user nova-compute[80928]:         <nova:project uuid="995121e71e234f60b7f7d5ac0abcc0f1">tempest-ServerBootFromVolumeStableRescueTest-1026359285</nova:project>
Nov 16 05:33:52 user nova-compute[80928]:       </nova:owner>
Nov 16 05:33:52 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:33:52 user nova-compute[80928]:       <nova:ports>
Nov 16 05:33:52 user nova-compute[80928]:         <nova:port uuid="af4426f7-2ac8-4035-98b1-7739d2acf95b">
Nov 16 05:33:52 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 05:33:52 user nova-compute[80928]:         </nova:port>
Nov 16 05:33:52 user nova-compute[80928]:       </nova:ports>
Nov 16 05:33:52 user nova-compute[80928]:     </nova:instance>
Nov 16 05:33:52 user nova-compute[80928]:   </metadata>
Nov 16 05:33:52 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:33:52 user nova-compute[80928]:     <system>
Nov 16 05:33:52 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:33:52 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:33:52 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:33:52 user nova-compute[80928]:       <entry name="serial">a39e1ed9-2651-4de2-8979-c030b02b0ee1</entry>
Nov 16 05:33:52 user nova-compute[80928]:       <entry name="uuid">a39e1ed9-2651-4de2-8979-c030b02b0ee1</entry>
Nov 16 05:33:52 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:33:52 user nova-compute[80928]:     </system>
Nov 16 05:33:52 user nova-compute[80928]:   </sysinfo>
Nov 16 05:33:52 user nova-compute[80928]:   <os>
Nov 16 05:33:52 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:33:52 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:33:52 user nova-compute[80928]:   </os>
Nov 16 05:33:52 user nova-compute[80928]:   <features>
Nov 16 05:33:52 user nova-compute[80928]:     <acpi/>
Nov 16 05:33:52 user nova-compute[80928]:     <apic/>
Nov 16 05:33:52 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:33:52 user nova-compute[80928]:   </features>
Nov 16 05:33:52 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:33:52 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:33:52 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:33:52 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:33:52 user nova-compute[80928]:   </clock>
Nov 16 05:33:52 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:33:52 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:33:52 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:33:52 user nova-compute[80928]:   </cpu>
Nov 16 05:33:52 user nova-compute[80928]:   <devices>
Nov 16 05:33:52 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:33:52 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:33:52 user nova-compute[80928]:       <source dev="/dev/sdb"/>
Nov 16 05:33:52 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:33:52 user nova-compute[80928]:       <serial>23705545-4fdf-464f-8bd3-064fcf28ed81</serial>
Nov 16 05:33:52 user nova-compute[80928]:     </disk>
Nov 16 05:33:52 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:33:52 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:33:52 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.rescue"/>
Nov 16 05:33:52 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:33:52 user nova-compute[80928]:       <boot order="1"/>
Nov 16 05:33:52 user nova-compute[80928]:     </disk>
Nov 16 05:33:52 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:33:52 user nova-compute[80928]:       <mac address="fa:16:3e:e5:51:e7"/>
Nov 16 05:33:52 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:33:52 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:33:52 user nova-compute[80928]:       <target dev="tapaf4426f7-2a"/>
Nov 16 05:33:52 user nova-compute[80928]:     </interface>
Nov 16 05:33:52 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:33:52 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/console.log" append="off"/>
Nov 16 05:33:52 user nova-compute[80928]:     </serial>
Nov 16 05:33:52 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:33:52 user nova-compute[80928]:     <video>
Nov 16 05:33:52 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:33:52 user nova-compute[80928]:     </video>
Nov 16 05:33:52 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:33:52 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:33:52 user nova-compute[80928]:     </rng>
Nov 16 05:33:52 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:33:52 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:33:52 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:33:52 user nova-compute[80928]:     </memballoon>
Nov 16 05:33:52 user nova-compute[80928]:   </devices>
Nov 16 05:33:52 user nova-compute[80928]: </domain>
Nov 16 05:33:52 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:33:52 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Instance destroyed successfully.
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No VIF found with MAC fa:16:3e:e5:51:e7, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:33:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-1817b7e3-de88-468d-b637-66155a03d3b3 req-eb8fd073-4f98-4896-a421-783a68d30504 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-unplugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:33:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1817b7e3-de88-468d-b637-66155a03d3b3 req-eb8fd073-4f98-4896-a421-783a68d30504 service nova] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1817b7e3-de88-468d-b637-66155a03d3b3 req-eb8fd073-4f98-4896-a421-783a68d30504 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1817b7e3-de88-468d-b637-66155a03d3b3 req-eb8fd073-4f98-4896-a421-783a68d30504 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-1817b7e3-de88-468d-b637-66155a03d3b3 req-eb8fd073-4f98-4896-a421-783a68d30504 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] No waiting events found dispatching network-vif-unplugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:33:54 user nova-compute[80928]: WARNING nova.compute.manager [req-1817b7e3-de88-468d-b637-66155a03d3b3 req-eb8fd073-4f98-4896-a421-783a68d30504 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received unexpected event network-vif-unplugged-af4426f7-2ac8-4035-98b1-7739d2acf95b for instance with vm_state active and task_state rescuing.
Nov 16 05:33:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:33:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-bb007c5c-96bd-47e3-a446-95172e98d976 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] No waiting events found dispatching network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:33:56 user nova-compute[80928]: WARNING nova.compute.manager [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received unexpected event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b for instance with vm_state rescued and task_state None.
Nov 16 05:33:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] No waiting events found dispatching network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:33:56 user nova-compute[80928]: WARNING nova.compute.manager [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received unexpected event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b for instance with vm_state rescued and task_state None.
Nov 16 05:33:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] No waiting events found dispatching network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:33:56 user nova-compute[80928]: WARNING nova.compute.manager [req-59f5b997-5e73-4d97-9e74-7e482bb826b7 req-4c26ede3-9f5d-45c4-ab20-cfb0532a5c39 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received unexpected event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b for instance with vm_state rescued and task_state None.
Nov 16 05:33:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-ff21d416-8ff1-49b5-9f2b-e55df3444e8f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-ff21d416-8ff1-49b5-9f2b-e55df3444e8f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:33:56 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:33:57 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Updating instance_info_cache with network_info: [{"id": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "address": "fa:16:3e:c0:a9:eb", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e24095-a5", "ovs_interfaceid": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:33:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-ff21d416-8ff1-49b5-9f2b-e55df3444e8f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:33:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:33:57 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:33:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:33:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:33:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:33:57 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:33:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:33:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:33:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:33:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:33:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:02 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:34:02 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:34:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7337MB free_disk=25.48440170288086GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:34:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5d03bda0-20b8-497a-a87b-faee21624468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5687e588-1245-42a9-b2d8-306c3c6bf8c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance d5e15464-01b2-4ad5-85e2-deeca243ceae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance d9495878-bdc8-4448-9a96-a93168cca9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 859f06da-737e-40c3-9e85-2fd33052a9ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 1d95a79b-847f-4eba-a096-65c834f94a40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:03 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:34:03 user nova-compute[80928]: INFO nova.compute.claims [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Claim successful on node user
Nov 16 05:34:04 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:34:04 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:34:04 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:34:04 user nova-compute[80928]: INFO nova.virt.block_device [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Booting with volume 35e4c943-129b-442f-89c6-7923123c3ed7 at /dev/vda
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG nova.policy [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ce09fc1320c4033baf06caf7282676a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde93358753b405293c50a4eb65a55a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG os_brick.utils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbbbcdc-6502-4c26-b19e-44b9711e75ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9ec65f-8385-4da8-b6fa-d0696e96f00d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[282480fb-55a1-4e18-bd41-84006bafc19e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55a5efd-2122-48ea-bf2b-d0a56d50c16a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:04 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:34:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7189516-51ba-47a9-a407-9dfe3ccf8e04]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG os_brick.utils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:04 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Updating existing volume attachment record: d4612111-e5e2-4ae7-94f9-db2db367d18c {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:34:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:05 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Successfully created port: 4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Successfully updated port: 4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "refresh_cache-b0211dc5-730f-435b-8d39-3a1606a7696f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquired lock "refresh_cache-b0211dc5-730f-435b-8d39-3a1606a7696f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-d80650e4-5e9a-460f-9bd6-9ade0469ac72 req-6e39cbe6-d7d3-4bd8-87a7-99e727f783f9 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event network-changed-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-d80650e4-5e9a-460f-9bd6-9ade0469ac72 req-6e39cbe6-d7d3-4bd8-87a7-99e727f783f9 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Refreshing instance network info cache due to event network-changed-4acbefc0-9505-48d7-9718-581771fcd450. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d80650e4-5e9a-460f-9bd6-9ade0469ac72 req-6e39cbe6-d7d3-4bd8-87a7-99e727f783f9 service nova] Acquiring lock "refresh_cache-b0211dc5-730f-435b-8d39-3a1606a7696f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Updating instance_info_cache with network_info: [{"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Releasing lock "refresh_cache-b0211dc5-730f-435b-8d39-3a1606a7696f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Instance network_info: |[{"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d80650e4-5e9a-460f-9bd6-9ade0469ac72 req-6e39cbe6-d7d3-4bd8-87a7-99e727f783f9 service nova] Acquired lock "refresh_cache-b0211dc5-730f-435b-8d39-3a1606a7696f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-d80650e4-5e9a-460f-9bd6-9ade0469ac72 req-6e39cbe6-d7d3-4bd8-87a7-99e727f783f9 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Refreshing network info cache for port 4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:06 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:34:06 user nova-compute[80928]: INFO nova.compute.claims [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Claim successful on node user
Nov 16 05:34:07 user nova-compute[80928]: DEBUG nova.network.neutron [req-d80650e4-5e9a-460f-9bd6-9ade0469ac72 req-6e39cbe6-d7d3-4bd8-87a7-99e727f783f9 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Updated VIF entry in instance network info cache for port 4acbefc0-9505-48d7-9718-581771fcd450. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG nova.network.neutron [req-d80650e4-5e9a-460f-9bd6-9ade0469ac72 req-6e39cbe6-d7d3-4bd8-87a7-99e727f783f9 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Updating instance_info_cache with network_info: [{"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d80650e4-5e9a-460f-9bd6-9ade0469ac72 req-6e39cbe6-d7d3-4bd8-87a7-99e727f783f9 service nova] Releasing lock "refresh_cache-b0211dc5-730f-435b-8d39-3a1606a7696f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:34:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:34:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:34:07 user nova-compute[80928]: INFO nova.virt.block_device [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Booting with volume 13c848a4-ab88-4cd2-a8fc-302d836528b0 at /dev/vda
Nov 16 05:34:07 user nova-compute[80928]: DEBUG nova.policy [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6e814096e334600bcfda87d6fd8cb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0b8244c3134053b614616307802f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG os_brick.utils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee08401-db60-4414-80e9-c689d88cf67d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1ae736-47f3-4ea5-bd62-2bfb8761f58b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9253f70f-5a2a-4c41-a819-dfcfb1e03ea0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3a18a4-e97b-4367-a97d-ef52960b0c6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:07 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:34:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82c3af0-ab40-420b-9bea-8ab6c70a296c]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG os_brick.utils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating existing volume attachment record: 60151c00-857b-45fe-941f-81cd64555a87 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:34:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:08 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Successfully created port: 9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:34:08 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Successfully created port: cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:34:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Successfully created port: 82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:34:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-cb16ded4-92b8-4de6-9ff1-d8dbdec7194c req-df6751bc-9801-445b-90be-f07ab13e95f6 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-changed-5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-cb16ded4-92b8-4de6-9ff1-d8dbdec7194c req-df6751bc-9801-445b-90be-f07ab13e95f6 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Refreshing instance network info cache due to event network-changed-5d98342e-40a0-4426-977e-b9c61886687b. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cb16ded4-92b8-4de6-9ff1-d8dbdec7194c req-df6751bc-9801-445b-90be-f07ab13e95f6 service nova] Acquiring lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cb16ded4-92b8-4de6-9ff1-d8dbdec7194c req-df6751bc-9801-445b-90be-f07ab13e95f6 service nova] Acquired lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-cb16ded4-92b8-4de6-9ff1-d8dbdec7194c req-df6751bc-9801-445b-90be-f07ab13e95f6 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Refreshing network info cache for port 5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Successfully created port: 52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "interface-d9495878-bdc8-4448-9a96-a93168cca9dd-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "interface-d9495878-bdc8-4448-9a96-a93168cca9dd-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.objects.instance [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lazy-loading 'flavor' on Instance uuid d9495878-bdc8-4448-9a96-a93168cca9dd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:34:10 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Creating image(s)
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Ensure instance console log exists: /opt/stack/data/nova/instances/b0211dc5-730f-435b-8d39-3a1606a7696f/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Start _get_guest_xml network_info=[{"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjFwbycI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0211dc5-730f-435b-8d39-3a1606a7696f', 'attached_at': '', 'detached_at': '', 'volume_id': '35e4c943-129b-442f-89c6-7923123c3ed7', 'serial': '35e4c943-129b-442f-89c6-7923123c3ed7'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd4612111-e5e2-4ae7-94f9-db2db367d18c', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:34:10 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:34:10 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjFwbycI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:10 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:10 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:10 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a168434c-5007-4849-a283-397f81f284bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:34:10 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0f7b03-c2de-447c-91dd-574d8caf0301]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7] added
Nov 16 05:34:10 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4490f5-7f45-4b43-ae6a-54fbdb63f42b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0746fa-f951-4b41-b907-ee7dde07de9e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjFwbycI {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjFwbycI" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afe9299-b396-4399-95cc-b75b76abfd4a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AjFwbycI'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fca9d3-7eec-4296-a2f8-9be0e2e6358c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a4ba52-dbf1-4920-b1c8-07503aa3ea65]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:10 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:34:10 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:10 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:34:10 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.network.neutron [req-cb16ded4-92b8-4de6-9ff1-d8dbdec7194c req-df6751bc-9801-445b-90be-f07ab13e95f6 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Updated VIF entry in instance network info cache for port 5d98342e-40a0-4426-977e-b9c61886687b. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.network.neutron [req-cb16ded4-92b8-4de6-9ff1-d8dbdec7194c req-df6751bc-9801-445b-90be-f07ab13e95f6 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Updating instance_info_cache with network_info: [{"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cb16ded4-92b8-4de6-9ff1-d8dbdec7194c req-df6751bc-9801-445b-90be-f07ab13e95f6 service nova] Releasing lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b9ab5e-4ff6-4ed1-9138-25b5ce1ec4e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260]
Nov 16 05:34:10 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260] successful.
Nov 16 05:34:10 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.objects.instance [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lazy-loading 'pci_requests' on Instance uuid d9495878-bdc8-4448-9a96-a93168cca9dd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.objects.base [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Object Instance<d9495878-bdc8-4448-9a96-a93168cca9dd> lazy-loaded attributes: flavor,pci_requests {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a3527e-ea1d-4173-b2f1-e09878cfb9b2]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f931aeb-0891-4152-8d1d-0e214a49c109]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:10 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:10 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:34:10 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:10 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:10 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:34:10 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[25186f2a-73f4-407c-b2a9-c7402d9c6f25]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjFwbycI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Successfully created port: c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:34:10 user nova-compute[80928]: DEBUG nova.policy [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aee02ffd699942259a6f10355af24e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070f9d7fdfa47138f3f58b567211b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Successfully created port: ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Successfully updated port: 9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.compute.manager [req-fed4258f-d88a-4601-9e3e-e49af1b9438d req-65037099-7c46-409b-96c3-6fcc83240f81 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-changed-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.compute.manager [req-fed4258f-d88a-4601-9e3e-e49af1b9438d req-65037099-7c46-409b-96c3-6fcc83240f81 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing instance network info cache due to event network-changed-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fed4258f-d88a-4601-9e3e-e49af1b9438d req-65037099-7c46-409b-96c3-6fcc83240f81 service nova] Acquiring lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fed4258f-d88a-4601-9e3e-e49af1b9438d req-65037099-7c46-409b-96c3-6fcc83240f81 service nova] Acquired lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.network.neutron [req-fed4258f-d88a-4601-9e3e-e49af1b9438d req-65037099-7c46-409b-96c3-6fcc83240f81 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing network info cache for port 9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.network.neutron [req-fed4258f-d88a-4601-9e3e-e49af1b9438d req-65037099-7c46-409b-96c3-6fcc83240f81 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:34:11 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5687e588-1245-42a9-b2d8-306c3c6bf8c5 is timed out.
Nov 16 05:34:11 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully detached device vdb from instance 5687e588-1245-42a9-b2d8-306c3c6bf8c5 from the live domain config.
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyjrQIzP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:11 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23337643732363432', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337643732363432', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.040s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1342069825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1342069825',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrww7sI55a3Trl1PjEiEIP4wlwDIEoLgs3TLCjEDtdyvuCgUJTQf3YJE0l8HAZq4ews1teuYYbO2FrUVPNoHQVhYuYAl1+w8B/UHR4F7VdE+bpMzQtOmJVEPqskAogcEg==',key_name='tempest-keypair-1036640328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dde93358753b405293c50a4eb65a55a8',ramdisk_id='',reservation_id='r-bx9ws9wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1532463154',owner_user_name='tempest-ServerActionsV293TestJSON-1532463154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce09fc1320c4033baf06caf7282676a',uuid=b0211dc5-730f-435b-8d39-3a1606a7696f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Converting VIF {"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.objects.instance [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lazy-loading 'pci_devices' on Instance uuid b0211dc5-730f-435b-8d39-3a1606a7696f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff380a6a-7e16-45b6-8e9d-12bd6816d9e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:34:11 user nova-compute[80928]: No targets found.
Nov 16 05:34:11 user nova-compute[80928]: iSNS:
Nov 16 05:34:11 user nova-compute[80928]: No targets found.
Nov 16 05:34:11 user nova-compute[80928]: STATIC:
Nov 16 05:34:11 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a
Nov 16 05:34:11 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:11 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:11 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7
Nov 16 05:34:11 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:11 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:11 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:34:11 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:11 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:11 user nova-compute[80928]: FIRMWARE:
Nov 16 05:34:11 user nova-compute[80928]: No targets found.
Nov 16 05:34:11 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:34:11 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:34:11 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:34:11 user nova-compute[80928]:   <uuid>b0211dc5-730f-435b-8d39-3a1606a7696f</uuid>
Nov 16 05:34:11 user nova-compute[80928]:   <name>instance-00000014</name>
Nov 16 05:34:11 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:34:11 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:34:11 user nova-compute[80928]:   <metadata>
Nov 16 05:34:11 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:34:11 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:34:11 user nova-compute[80928]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1342069825</nova:name>
Nov 16 05:34:11 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:34:10</nova:creationTime>
Nov 16 05:34:11 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:34:11 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:34:11 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:34:11 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:34:11 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:34:11 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:34:11 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:34:11 user nova-compute[80928]:       <nova:owner>
Nov 16 05:34:11 user nova-compute[80928]:         <nova:user uuid="7ce09fc1320c4033baf06caf7282676a">tempest-ServerActionsV293TestJSON-1532463154-project-member</nova:user>
Nov 16 05:34:11 user nova-compute[80928]:         <nova:project uuid="dde93358753b405293c50a4eb65a55a8">tempest-ServerActionsV293TestJSON-1532463154</nova:project>
Nov 16 05:34:11 user nova-compute[80928]:       </nova:owner>
Nov 16 05:34:11 user nova-compute[80928]:       <nova:ports>
Nov 16 05:34:11 user nova-compute[80928]:         <nova:port uuid="4acbefc0-9505-48d7-9718-581771fcd450">
Nov 16 05:34:11 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 05:34:11 user nova-compute[80928]:         </nova:port>
Nov 16 05:34:11 user nova-compute[80928]:       </nova:ports>
Nov 16 05:34:11 user nova-compute[80928]:     </nova:instance>
Nov 16 05:34:11 user nova-compute[80928]:   </metadata>
Nov 16 05:34:11 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:34:11 user nova-compute[80928]:     <system>
Nov 16 05:34:11 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:34:11 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:34:11 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:34:11 user nova-compute[80928]:       <entry name="serial">b0211dc5-730f-435b-8d39-3a1606a7696f</entry>
Nov 16 05:34:11 user nova-compute[80928]:       <entry name="uuid">b0211dc5-730f-435b-8d39-3a1606a7696f</entry>
Nov 16 05:34:11 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:34:11 user nova-compute[80928]:     </system>
Nov 16 05:34:11 user nova-compute[80928]:   </sysinfo>
Nov 16 05:34:11 user nova-compute[80928]:   <os>
Nov 16 05:34:11 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:34:11 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:34:11 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:34:11 user nova-compute[80928]:   </os>
Nov 16 05:34:11 user nova-compute[80928]:   <features>
Nov 16 05:34:11 user nova-compute[80928]:     <acpi/>
Nov 16 05:34:11 user nova-compute[80928]:     <apic/>
Nov 16 05:34:11 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:34:11 user nova-compute[80928]:   </features>
Nov 16 05:34:11 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:34:11 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:34:11 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:34:11 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:34:11 user nova-compute[80928]:   </clock>
Nov 16 05:34:11 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:34:11 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:34:11 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:34:11 user nova-compute[80928]:   </cpu>
Nov 16 05:34:11 user nova-compute[80928]:   <devices>
Nov 16 05:34:11 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:34:11 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:34:11 user nova-compute[80928]:       <source dev="/dev/sdc"/>
Nov 16 05:34:11 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:34:11 user nova-compute[80928]:       <serial>35e4c943-129b-442f-89c6-7923123c3ed7</serial>
Nov 16 05:34:11 user nova-compute[80928]:     </disk>
Nov 16 05:34:11 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:34:11 user nova-compute[80928]:       <mac address="fa:16:3e:4b:36:0b"/>
Nov 16 05:34:11 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:34:11 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:34:11 user nova-compute[80928]:       <target dev="tap4acbefc0-95"/>
Nov 16 05:34:11 user nova-compute[80928]:     </interface>
Nov 16 05:34:11 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:34:11 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/b0211dc5-730f-435b-8d39-3a1606a7696f/console.log" append="off"/>
Nov 16 05:34:11 user nova-compute[80928]:     </serial>
Nov 16 05:34:11 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:34:11 user nova-compute[80928]:     <video>
Nov 16 05:34:11 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:34:11 user nova-compute[80928]:     </video>
Nov 16 05:34:11 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:34:11 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:34:11 user nova-compute[80928]:     </rng>
Nov 16 05:34:11 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:34:11 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:34:11 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:34:11 user nova-compute[80928]:     </memballoon>
Nov 16 05:34:11 user nova-compute[80928]:   </devices>
Nov 16 05:34:11 user nova-compute[80928]: </domain>
Nov 16 05:34:11 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1342069825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1342069825',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrww7sI55a3Trl1PjEiEIP4wlwDIEoLgs3TLCjEDtdyvuCgUJTQf3YJE0l8HAZq4ews1teuYYbO2FrUVPNoHQVhYuYAl1+w8B/UHR4F7VdE+bpMzQtOmJVEPqskAogcEg==',key_name='tempest-keypair-1036640328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dde93358753b405293c50a4eb65a55a8',ramdisk_id='',reservation_id='r-bx9ws9wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1532463154',owner_user_name='tempest-ServerActionsV293TestJSON-1532463154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce09fc1320c4033baf06caf7282676a',uuid=b0211dc5-730f-435b-8d39-3a1606a7696f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Converting VIF {"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_vif [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3bae26-9299-4c44-aa63-c4b75ed4d2b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eaa00514-f615-5c7c-8952-12c862355b07', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4acbefc0-95, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4acbefc0-95, col_values=(('qos', UUID('06d08fdd-6040-41fc-8ca7-a306fe4e2b77')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4acbefc0-95, col_values=(('external_ids', {'iface-id': '4acbefc0-9505-48d7-9718-581771fcd450', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:36:0b', 'vm-uuid': 'b0211dc5-730f-435b-8d39-3a1606a7696f'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:11 user nova-compute[80928]: INFO os_vif [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95')
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a7b547-43f9-437f-a5d4-4ca9c70dd88f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:11 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:11 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:34:11 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:11 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:11 user nova-compute[80928]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a (non-flash)
Nov 16 05:34:11 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8658439000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a'): ({'sdf'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Removing single pathed devices sdf {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[196e8fce-c2de-464b-a35b-85fe7fc55afd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] No VIF found with MAC fa:16:3e:4b:36:0b, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8052655-d272-47a0-b463-3898d94a6ae0]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Flushing IO for device /dev/sdf {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.network.neutron [req-fed4258f-d88a-4601-9e3e-e49af1b9438d req-65037099-7c46-409b-96c3-6fcc83240f81 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1375c6c2-9673-4a9b-9d92-5ed74f446d29]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fed4258f-d88a-4601-9e3e-e49af1b9438d req-65037099-7c46-409b-96c3-6fcc83240f81 service nova] Releasing lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7091a837-faf8-42e0-adb2-b36a3c9c8f22]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] SCSI volumes sdf have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db92c59-de58-47b7-ac9e-7cf67dcf5e0b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Successfully updated port: d9818988-0285-454f-8f12-52d9203cc9ea {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4de027a-822b-4003-a43a-7142213ce52f]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a, portal: 172.16.0.220,3260]
Nov 16 05:34:11 user nova-compute[80928]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a, portal: 172.16.0.220,3260] successful.
Nov 16 05:34:11 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a647a8dd-46fe-40a4-9628-79364cacf96a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9284d69e-6eb3-42f4-893f-5dc055332ac7]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] <== disconnect_volume: return (393ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Successfully updated port: ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquired lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.compute.manager [req-a295b9f3-875b-4790-856a-53bbd5083283 req-b006daaf-c46a-4d4e-935b-d4539a2746eb service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-changed-ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.compute.manager [req-a295b9f3-875b-4790-856a-53bbd5083283 req-b006daaf-c46a-4d4e-935b-d4539a2746eb service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Refreshing instance network info cache due to event network-changed-ab94c533-dec6-4247-98b3-06659931293c. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a295b9f3-875b-4790-856a-53bbd5083283 req-b006daaf-c46a-4d4e-935b-d4539a2746eb service nova] Acquiring lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Successfully updated port: 664f643e-408b-4ebe-b6f3-4c8c2dc908de {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Updating instance_info_cache with network_info: [{"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab94c533-dec6-4247-98b3-06659931293c", "address": "fa:16:3e:0a:57:8a", "network": {"id": "6a41470f-2152-4682-b333-e3702141f978", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1925366456", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab94c533-de", "ovs_interfaceid": "ab94c533-dec6-4247-98b3-06659931293c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Releasing lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a295b9f3-875b-4790-856a-53bbd5083283 req-b006daaf-c46a-4d4e-935b-d4539a2746eb service nova] Acquired lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.network.neutron [req-a295b9f3-875b-4790-856a-53bbd5083283 req-b006daaf-c46a-4d4e-935b-d4539a2746eb service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Refreshing network info cache for port ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "d5e15464-01b2-4ad5-85e2-deeca243ceae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:12 user nova-compute[80928]: INFO nova.compute.manager [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Terminating instance
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448719116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448719116',id=16,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbrfYM9Tfxryjx25pcrdzFi6aMDXg1GtvKXo5V5iWQ1HHL8WU/nWyrqQDT+9C4YMMZjtHiahtk+lIZb+3YjTrRbWV9Wq2Su/5MArY3ntN9SR2zMGcvMMV9nYJ5E0xygtw==',key_name='tempest-keypair-1199152231',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:32:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d070f9d7fdfa47138f3f58b567211b71',ramdisk_id='',reservation_id='r-6v774qk5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-878046877',owner_user_name='tempest-TaggedAttachmentsTest-878046877-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee02ffd699942259a6f10355af24e94',uuid=d9495878-bdc8-4448-9a96-a93168cca9dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab94c533-dec6-4247-98b3-06659931293c", "address": "fa:16:3e:0a:57:8a", "network": {"id": "6a41470f-2152-4682-b333-e3702141f978", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1925366456", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab94c533-de", "ovs_interfaceid": "ab94c533-dec6-4247-98b3-06659931293c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converting VIF {"id": "ab94c533-dec6-4247-98b3-06659931293c", "address": "fa:16:3e:0a:57:8a", "network": {"id": "6a41470f-2152-4682-b333-e3702141f978", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1925366456", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab94c533-de", "ovs_interfaceid": "ab94c533-dec6-4247-98b3-06659931293c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:57:8a,bridge_name='br-int',has_traffic_filtering=True,id=ab94c533-dec6-4247-98b3-06659931293c,network=Network(6a41470f-2152-4682-b333-e3702141f978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab94c533-de') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG os_vif [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:57:8a,bridge_name='br-int',has_traffic_filtering=True,id=ab94c533-dec6-4247-98b3-06659931293c,network=Network(6a41470f-2152-4682-b333-e3702141f978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab94c533-de') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.compute.manager [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '765ca7ea-8b09-5ce9-ac65-f4c4eb98e28e', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab94c533-de, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab94c533-de, col_values=(('qos', UUID('45b681a3-d6b3-45d4-a731-40892ebf2ad5')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab94c533-de, col_values=(('external_ids', {'iface-id': 'ab94c533-dec6-4247-98b3-06659931293c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:57:8a', 'vm-uuid': 'd9495878-bdc8-4448-9a96-a93168cca9dd'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:12 user nova-compute[80928]: INFO os_vif [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:57:8a,bridge_name='br-int',has_traffic_filtering=True,id=ab94c533-dec6-4247-98b3-06659931293c,network=Network(6a41470f-2152-4682-b333-e3702141f978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab94c533-de')
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448719116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448719116',id=16,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbrfYM9Tfxryjx25pcrdzFi6aMDXg1GtvKXo5V5iWQ1HHL8WU/nWyrqQDT+9C4YMMZjtHiahtk+lIZb+3YjTrRbWV9Wq2Su/5MArY3ntN9SR2zMGcvMMV9nYJ5E0xygtw==',key_name='tempest-keypair-1199152231',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:32:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d070f9d7fdfa47138f3f58b567211b71',ramdisk_id='',reservation_id='r-6v774qk5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-878046877',owner_user_name='tempest-TaggedAttachmentsTest-878046877-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee02ffd699942259a6f10355af24e94',uuid=d9495878-bdc8-4448-9a96-a93168cca9dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab94c533-dec6-4247-98b3-06659931293c", "address": "fa:16:3e:0a:57:8a", "network": {"id": "6a41470f-2152-4682-b333-e3702141f978", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1925366456", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab94c533-de", "ovs_interfaceid": "ab94c533-dec6-4247-98b3-06659931293c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converting VIF {"id": "ab94c533-dec6-4247-98b3-06659931293c", "address": "fa:16:3e:0a:57:8a", "network": {"id": "6a41470f-2152-4682-b333-e3702141f978", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1925366456", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab94c533-de", "ovs_interfaceid": "ab94c533-dec6-4247-98b3-06659931293c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:57:8a,bridge_name='br-int',has_traffic_filtering=True,id=ab94c533-dec6-4247-98b3-06659931293c,network=Network(6a41470f-2152-4682-b333-e3702141f978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab94c533-de') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] attach device xml: <interface type="ethernet">
Nov 16 05:34:12 user nova-compute[80928]:   <mac address="fa:16:3e:0a:57:8a"/>
Nov 16 05:34:12 user nova-compute[80928]:   <model type="virtio"/>
Nov 16 05:34:12 user nova-compute[80928]:   <mtu size="1442"/>
Nov 16 05:34:12 user nova-compute[80928]:   <target dev="tapab94c533-de"/>
Nov 16 05:34:12 user nova-compute[80928]: </interface>
Nov 16 05:34:12 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG nova.objects.instance [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'flavor' on Instance uuid 5687e588-1245-42a9-b2d8-306c3c6bf8c5 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9b699278-b0dd-49e3-88b6-6db9e9a49af3 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.462s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.network.neutron [req-a295b9f3-875b-4790-856a-53bbd5083283 req-b006daaf-c46a-4d4e-935b-d4539a2746eb service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Updated VIF entry in instance network info cache for port ab94c533-dec6-4247-98b3-06659931293c. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.network.neutron [req-a295b9f3-875b-4790-856a-53bbd5083283 req-b006daaf-c46a-4d4e-935b-d4539a2746eb service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Updating instance_info_cache with network_info: [{"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab94c533-dec6-4247-98b3-06659931293c", "address": "fa:16:3e:0a:57:8a", "network": {"id": "6a41470f-2152-4682-b333-e3702141f978", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1925366456", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab94c533-de", "ovs_interfaceid": "ab94c533-dec6-4247-98b3-06659931293c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a295b9f3-875b-4790-856a-53bbd5083283 req-b006daaf-c46a-4d4e-935b-d4539a2746eb service nova] Releasing lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Successfully updated port: cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-changed-d9818988-0285-454f-8f12-52d9203cc9ea {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing instance network info cache due to event network-changed-d9818988-0285-454f-8f12-52d9203cc9ea. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] Acquiring lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] Acquired lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.network.neutron [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing network info cache for port d9818988-0285-454f-8f12-52d9203cc9ea {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:13 user nova-compute[80928]: INFO nova.virt.block_device [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Booting with volume 09dfc924-be3b-4968-b87f-fd18cb353ff6 at /dev/vdb
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] No BDM found with device name hda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] No VIF found with MAC fa:16:3e:9d:25:09, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:34:13 user nova-compute[80928]:   <nova:package version="0.0.0"/>
Nov 16 05:34:13 user nova-compute[80928]:   <nova:name>tempest-device-tagging-server-448719116</nova:name>
Nov 16 05:34:13 user nova-compute[80928]:   <nova:creationTime>2023-11-16 05:34:13</nova:creationTime>
Nov 16 05:34:13 user nova-compute[80928]:   <nova:flavor name="m1.tiny">
Nov 16 05:34:13 user nova-compute[80928]:     <nova:memory>512</nova:memory>
Nov 16 05:34:13 user nova-compute[80928]:     <nova:disk>1</nova:disk>
Nov 16 05:34:13 user nova-compute[80928]:     <nova:swap>0</nova:swap>
Nov 16 05:34:13 user nova-compute[80928]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:34:13 user nova-compute[80928]:     <nova:vcpus>1</nova:vcpus>
Nov 16 05:34:13 user nova-compute[80928]:   </nova:flavor>
Nov 16 05:34:13 user nova-compute[80928]:   <nova:owner>
Nov 16 05:34:13 user nova-compute[80928]:     <nova:user uuid="aee02ffd699942259a6f10355af24e94">tempest-TaggedAttachmentsTest-878046877-project-member</nova:user>
Nov 16 05:34:13 user nova-compute[80928]:     <nova:project uuid="d070f9d7fdfa47138f3f58b567211b71">tempest-TaggedAttachmentsTest-878046877</nova:project>
Nov 16 05:34:13 user nova-compute[80928]:   </nova:owner>
Nov 16 05:34:13 user nova-compute[80928]:   <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:34:13 user nova-compute[80928]:   <nova:ports>
Nov 16 05:34:13 user nova-compute[80928]:     <nova:port uuid="5d98342e-40a0-4426-977e-b9c61886687b">
Nov 16 05:34:13 user nova-compute[80928]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 05:34:13 user nova-compute[80928]:     </nova:port>
Nov 16 05:34:13 user nova-compute[80928]:     <nova:port uuid="ab94c533-dec6-4247-98b3-06659931293c">
Nov 16 05:34:13 user nova-compute[80928]:       <nova:ip type="fixed" address="10.10.10.157" ipVersion="4"/>
Nov 16 05:34:13 user nova-compute[80928]:     </nova:port>
Nov 16 05:34:13 user nova-compute[80928]:   </nova:ports>
Nov 16 05:34:13 user nova-compute[80928]: </nova:instance>
Nov 16 05:34:13 user nova-compute[80928]:  {{(pid=80928) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.network.neutron [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG os_brick.utils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3cf3504-cf0c-4c63-81b2-89f0fa4ae4d3 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "interface-d9495878-bdc8-4448-9a96-a93168cca9dd-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.542s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d90e9e7-a1e1-40b3-b635-883ce2929460]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8442740a-5c81-49e3-9f00-1527b733657f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92fd3f4-48c1-42c3-96d3-a04dd4e67e56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f72b508-e662-4630-a60a-71966d233bf4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:13 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e1c8a1-afaa-4e6f-b4e5-b0ebf32b31e9]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG os_brick.utils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating existing volume attachment record: c8ebffa2-e6df-4ee6-90e5-8be60584fa91 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.network.neutron [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] Releasing lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-changed-664f643e-408b-4ebe-b6f3-4c8c2dc908de {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing instance network info cache due to event network-changed-664f643e-408b-4ebe-b6f3-4c8c2dc908de. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] Acquiring lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] Acquired lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:13 user nova-compute[80928]: DEBUG nova.network.neutron [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing network info cache for port 664f643e-408b-4ebe-b6f3-4c8c2dc908de {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.network.neutron [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Instance destroyed successfully.
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.objects.instance [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lazy-loading 'resources' on Instance uuid d5e15464-01b2-4ad5-85e2-deeca243ceae {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Received event network-vif-unplugged-87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] Acquiring lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] No waiting events found dispatching network-vif-unplugged-87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Received event network-vif-unplugged-87ae38df-dd48-469c-9387-5ab98e6a8430 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Received event network-vif-plugged-87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] Acquiring lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] No waiting events found dispatching network-vif-plugged-87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:14 user nova-compute[80928]: WARNING nova.compute.manager [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Received unexpected event network-vif-plugged-87ae38df-dd48-469c-9387-5ab98e6a8430 for instance with vm_state active and task_state deleting.
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] No waiting events found dispatching network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:14 user nova-compute[80928]: WARNING nova.compute.manager [req-bd103b8b-1ad3-402f-a773-0f8f4d4cb2aa req-cb993b6c-da40-420c-ac88-1db9740161d1 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received unexpected event network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 for instance with vm_state building and task_state spawning.
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1295275796',display_name='tempest-VolumesAdminNegativeTest-server-1295275796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1295275796',id=15,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:32:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cd2b878ead545479dc4546aab5a076e',ramdisk_id='',reservation_id='r-oj3bys0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1417091548',owner_user_name='tempest-VolumesAdminNegativeTest-1417091548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:32:26Z,user_data=None,user_id='4c3163e6f11b436f980f9ffc443d4d20',uuid=d5e15464-01b2-4ad5-85e2-deeca243ceae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87ae38df-dd48-469c-9387-5ab98e6a8430", "address": "fa:16:3e:85:64:f6", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ae38df-dd", "ovs_interfaceid": "87ae38df-dd48-469c-9387-5ab98e6a8430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Converting VIF {"id": "87ae38df-dd48-469c-9387-5ab98e6a8430", "address": "fa:16:3e:85:64:f6", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ae38df-dd", "ovs_interfaceid": "87ae38df-dd48-469c-9387-5ab98e6a8430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:64:f6,bridge_name='br-int',has_traffic_filtering=True,id=87ae38df-dd48-469c-9387-5ab98e6a8430,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ae38df-dd') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG os_vif [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:64:f6,bridge_name='br-int',has_traffic_filtering=True,id=87ae38df-dd48-469c-9387-5ab98e6a8430,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ae38df-dd') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87ae38df-dd, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80b763ac-59b1-49cb-9cd4-fe2106fe0f5e) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:14 user nova-compute[80928]: INFO os_vif [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:64:f6,bridge_name='br-int',has_traffic_filtering=True,id=87ae38df-dd48-469c-9387-5ab98e6a8430,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ae38df-dd')
Nov 16 05:34:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Deleting instance files /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae_del
Nov 16 05:34:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Deletion of /opt/stack/data/nova/instances/d5e15464-01b2-4ad5-85e2-deeca243ceae_del complete
Nov 16 05:34:14 user nova-compute[80928]: INFO nova.compute.manager [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.network.neutron [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0bcced1f-b680-4df1-964f-e3492334b577 req-be698721-f9f2-4f59-a536-6157a1f37c72 service nova] Releasing lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lazy-loading 'flavor' on Instance uuid d9495878-bdc8-4448-9a96-a93168cca9dd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:14 user nova-compute[80928]: INFO nova.compute.manager [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Attaching volume 557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca to /dev/vdb
Nov 16 05:34:14 user nova-compute[80928]: DEBUG os_brick.utils [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[06101bb9-7909-437c-ad9b-cf5a4ded21e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db901bb-d39c-4c4b-90c1-2d8cf2a1f84c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[807b0edc-830e-4f96-b0ec-4ce6ae33f284]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db27e6d-251c-42a5-b982-917db4faee44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Successfully updated port: 82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:34:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:15 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f619d39-ed2f-4011-8c26-d7f1f3663464]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG os_brick.utils [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Updating existing volume attachment record: 9769d244-554a-4439-b6a7-84f1a3778920 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:34:15 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Took 0.78 seconds to deallocate network for instance.
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-vif-plugged-ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] No waiting events found dispatching network-vif-plugged-ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:15 user nova-compute[80928]: WARNING nova.compute.manager [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received unexpected event network-vif-plugged-ab94c533-dec6-4247-98b3-06659931293c for instance with vm_state active and task_state None.
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-changed-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing instance network info cache due to event network-changed-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] Acquiring lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] Acquired lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.network.neutron [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing network info cache for port cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.network.neutron [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.network.neutron [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] Releasing lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-vif-plugged-ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] No waiting events found dispatching network-vif-plugged-ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:15 user nova-compute[80928]: WARNING nova.compute.manager [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received unexpected event network-vif-plugged-ab94c533-dec6-4247-98b3-06659931293c for instance with vm_state active and task_state None.
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-changed-82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing instance network info cache due to event network-changed-82ed7dc5-8a5c-4283-acdc-1936c1af2011. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] Acquiring lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] Acquired lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.network.neutron [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing network info cache for port 82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.629s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:15 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Deleted allocations for instance d5e15464-01b2-4ad5-85e2-deeca243ceae
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:15 user nova-compute[80928]: INFO nova.compute.manager [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Unshelving
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.network.neutron [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:34:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-25c1b536-1471-4719-bf1a-0ebd52b5a8e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "d5e15464-01b2-4ad5-85e2-deeca243ceae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.257s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:15 user nova-compute[80928]: INFO nova.virt.block_device [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Booting with volume f530422d-5a49-40b4-a9ce-6d67b438dac4 at /dev/vda
Nov 16 05:34:15 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Successfully updated port: 52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG os_brick.utils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8482097-5802-48d5-911e-224954bd24eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e1385a-ff02-449c-bd3a-eab6a26966b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a3bbf5-076d-42de-9315-dafbbec4cc6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:16 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Instance spawned successfully.
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[64893d6e-db4f-44e4-a896-9e5269ddd4c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.network.neutron [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:16 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4983252d-a023-45da-9c5f-706d8de7fd8f]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc78ebd9-6fb1-4e0d-88b1-0f330635a1ba req-164244cd-b260-4ef5-bb2e-ada3d9dfee6a service nova] Releasing lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG os_brick.utils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updating existing volume attachment record: 6e3f611b-87ba-49a9-b7b7-3077c28fad36 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] No waiting events found dispatching network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:16 user nova-compute[80928]: WARNING nova.compute.manager [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received unexpected event network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 for instance with vm_state building and task_state spawning.
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] [instance: d5e15464-01b2-4ad5-85e2-deeca243ceae] Received event network-vif-deleted-87ae38df-dd48-469c-9387-5ab98e6a8430 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-changed-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing instance network info cache due to event network-changed-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] Acquiring lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] Acquired lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.network.neutron [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing network info cache for port 52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:16 user nova-compute[80928]: INFO nova.compute.manager [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.network.neutron [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:34:16 user nova-compute[80928]: INFO nova.compute.manager [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Took 12.55 seconds to build instance.
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8f501d63-5a13-4e71-a773-1d0731c39168 tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.650s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.network.neutron [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4f06e611-0a97-430e-aab6-8f1db6236106 req-de9ac4e5-957a-4975-8052-ac51bea3aa2e service nova] Releasing lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Successfully updated port: c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquired lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:34:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:34:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-dd1073ce-0721-4b99-985d-7da0727cf16f req-19d16511-a844-4016-9935-6366e1d9378b service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-changed-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-dd1073ce-0721-4b99-985d-7da0727cf16f req-19d16511-a844-4016-9935-6366e1d9378b service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing instance network info cache due to event network-changed-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dd1073ce-0721-4b99-985d-7da0727cf16f req-19d16511-a844-4016-9935-6366e1d9378b service nova] Acquiring lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:18 user nova-compute[80928]: DEBUG nova.network.neutron [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating instance_info_cache with network_info: [{"id": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "address": "fa:16:3e:5a:19:22", "network": {"id": "f1667eb3-5f9d-4355-9dad-a8703a9ad783", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213234258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9211fa0b-0c", "ovs_interfaceid": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9818988-0285-454f-8f12-52d9203cc9ea", "address": "fa:16:3e:8d:38:fe", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9818988-02", "ovs_interfaceid": "d9818988-0285-454f-8f12-52d9203cc9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "address": "fa:16:3e:fb:ef:67", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664f643e-40", "ovs_interfaceid": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "address": "fa:16:3e:e1:66:8d", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9bc7ae-c5", "ovs_interfaceid": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "address": "fa:16:3e:b1:8b:be", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ed7dc5-8a", "ovs_interfaceid": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "address": "fa:16:3e:90:82:99", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dc6d2a-f0", "ovs_interfaceid": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "address": "fa:16:3e:0e:0b:f3", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26dc4cc-11", "ovs_interfaceid": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Releasing lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Instance network_info: |[{"id": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "address": "fa:16:3e:5a:19:22", "network": {"id": "f1667eb3-5f9d-4355-9dad-a8703a9ad783", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213234258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9211fa0b-0c", "ovs_interfaceid": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9818988-0285-454f-8f12-52d9203cc9ea", "address": "fa:16:3e:8d:38:fe", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9818988-02", "ovs_interfaceid": "d9818988-0285-454f-8f12-52d9203cc9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "address": "fa:16:3e:fb:ef:67", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664f643e-40", "ovs_interfaceid": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "address": "fa:16:3e:e1:66:8d", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9bc7ae-c5", "ovs_interfaceid": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "address": "fa:16:3e:b1:8b:be", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ed7dc5-8a", "ovs_interfaceid": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "address": "fa:16:3e:90:82:99", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dc6d2a-f0", "ovs_interfaceid": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "address": "fa:16:3e:0e:0b:f3", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26dc4cc-11", "ovs_interfaceid": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:34:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dd1073ce-0721-4b99-985d-7da0727cf16f req-19d16511-a844-4016-9935-6366e1d9378b service nova] Acquired lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:18 user nova-compute[80928]: DEBUG nova.network.neutron [req-dd1073ce-0721-4b99-985d-7da0727cf16f req-19d16511-a844-4016-9935-6366e1d9378b service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing network info cache for port c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG nova.network.neutron [req-dd1073ce-0721-4b99-985d-7da0727cf16f req-19d16511-a844-4016-9935-6366e1d9378b service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updated VIF entry in instance network info cache for port c26dc4cc-11a1-42fb-ab32-1b712ed83ecb. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG nova.network.neutron [req-dd1073ce-0721-4b99-985d-7da0727cf16f req-19d16511-a844-4016-9935-6366e1d9378b service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating instance_info_cache with network_info: [{"id": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "address": "fa:16:3e:5a:19:22", "network": {"id": "f1667eb3-5f9d-4355-9dad-a8703a9ad783", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213234258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9211fa0b-0c", "ovs_interfaceid": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9818988-0285-454f-8f12-52d9203cc9ea", "address": "fa:16:3e:8d:38:fe", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9818988-02", "ovs_interfaceid": "d9818988-0285-454f-8f12-52d9203cc9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "address": "fa:16:3e:fb:ef:67", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664f643e-40", "ovs_interfaceid": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "address": "fa:16:3e:e1:66:8d", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9bc7ae-c5", "ovs_interfaceid": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "address": "fa:16:3e:b1:8b:be", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ed7dc5-8a", "ovs_interfaceid": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "address": "fa:16:3e:90:82:99", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dc6d2a-f0", "ovs_interfaceid": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "address": "fa:16:3e:0e:0b:f3", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26dc4cc-11", "ovs_interfaceid": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dd1073ce-0721-4b99-985d-7da0727cf16f req-19d16511-a844-4016-9935-6366e1d9378b service nova] Releasing lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:19 user nova-compute[80928]: INFO nova.virt.block_device [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Booting with volume 3151297c-1f63-431d-bc0b-f9f6e45dacd0 at /dev/vdc
Nov 16 05:34:19 user nova-compute[80928]: DEBUG os_brick.utils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e098c-b50c-4485-b485-ddb2669fffd7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca316b5f-32fe-4a36-969b-e850e1d41306]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ba1bb8-19b1-4dd0-b8f1-dc779d70febc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a8ddb4-3b98-42d4-97ba-88684c588f01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:19 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:34:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1963efd1-9842-41fd-b2c7-01dbe3a47022]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG os_brick.utils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:19 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating existing volume attachment record: 6cd19923-50ce-473b-9329-819c2bc127f2 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRZfMoHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:20 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:20 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:20 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a412f10-3c16-40f0-80a6-7d3ba6d0b356]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:34:20 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e372b093-fc9e-49af-9591-9a342b9e04ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca] added
Nov 16 05:34:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f181bad-958b-4588-90c0-0d855769335f]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c638f0-a1a9-4b93-835f-7f4991d11783]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lRZfMoHt {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lRZfMoHt" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cd2cf4-e6ce-4bf6-ab87-bc4448044f71]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lRZfMoHt'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[425b1767-d318-475e-b4b2-7aa88974ddd3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0138ce03-ce06-4c95-b30d-bfddcaeaace1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:20 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:20 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ff4d11-610c-43a6-862f-5cb6af52e587]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca, portal: 172.16.0.220,3260]
Nov 16 05:34:20 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca, portal: 172.16.0.220,3260] successful.
Nov 16 05:34:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1df84c-d7fa-4cd3-b445-e8074afae8df]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[56327578-5f3e-49d8-b239-5735bb0f72fe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:20 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:20 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:20 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:20 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01f8958-7836-441f-9d99-5de18e92ae40]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:34:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRZfMoHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:34:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:21 user nova-compute[80928]: DEBUG nova.objects.instance [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lazy-loading 'pci_requests' on Instance uuid 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:21 user nova-compute[80928]: DEBUG nova.objects.instance [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lazy-loading 'numa_topology' on Instance uuid 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:34:21 user nova-compute[80928]: INFO nova.compute.claims [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Claim successful on node user
Nov 16 05:34:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23864623066303038', 'path': '/dev/sdd'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864623066303038', 'path': '/dev/sdd'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:34:21 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lazy-loading 'flavor' on Instance uuid d9495878-bdc8-4448-9a96-a93168cca9dd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:34:21 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:34:21 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:34:21 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:34:21 user nova-compute[80928]:   <serial>557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca</serial>
Nov 16 05:34:21 user nova-compute[80928]: </disk>
Nov 16 05:34:21 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:34:22 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:34:22 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:34:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:34:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] No BDM found with device name hda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:34:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] No VIF found with MAC fa:16:3e:9d:25:09, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:34:22 user nova-compute[80928]: INFO nova.network.neutron [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updating port 04d9eb71-77a9-453e-94e3-b5356df3a824 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 05:34:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e88acb73-576a-4be1-92e8-3e8a3cb302c9 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.780s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquired lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.network.neutron [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-ecd2a977-97bb-4096-be34-23b8a2bd4c2b req-c84200fa-922b-4666-acfb-72641d0fc0d8 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-changed-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-ecd2a977-97bb-4096-be34-23b8a2bd4c2b req-c84200fa-922b-4666-acfb-72641d0fc0d8 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Refreshing instance network info cache due to event network-changed-04d9eb71-77a9-453e-94e3-b5356df3a824. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ecd2a977-97bb-4096-be34-23b8a2bd4c2b req-c84200fa-922b-4666-acfb-72641d0fc0d8 service nova] Acquiring lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.network.neutron [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updating instance_info_cache with network_info: [{"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Releasing lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:34:23 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Creating image(s)
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Ensure instance console log exists: /opt/stack/data/nova/instances/30c2bba7-99d9-4eea-8569-bf726c6ba2c8/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Start _get_guest_xml network_info=[{"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfPUCdIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '30c2bba7-99d9-4eea-8569-bf726c6ba2c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f530422d-5a49-40b4-a9ce-6d67b438dac4', 'serial': 'f530422d-5a49-40b4-a9ce-6d67b438dac4'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '6e3f611b-87ba-49a9-b7b7-3077c28fad36', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ecd2a977-97bb-4096-be34-23b8a2bd4c2b req-c84200fa-922b-4666-acfb-72641d0fc0d8 service nova] Acquired lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-ecd2a977-97bb-4096-be34-23b8a2bd4c2b req-c84200fa-922b-4666-acfb-72641d0fc0d8 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Refreshing network info cache for port 04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:23 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:34:23 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.objects.instance [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.objects.base [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Object Instance<30c2bba7-99d9-4eea-8569-bf726c6ba2c8> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfPUCdIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:23 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:23 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:23 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc37813c-6388-450b-879c-b24bf3792d49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:34:23 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:23 user nova-compute[80928]: INFO nova.compute.manager [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Detaching volume 557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2507c01f-fb75-49d3-b486-d5c03f092413]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4] added
Nov 16 05:34:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:23 user nova-compute[80928]: INFO nova.virt.block_device [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Attempting to driver detach volume 557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca from mountpoint /dev/vdb
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.121s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63e7e16-0fe5-46f5-b934-fc309cdcc368]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Attempting to detach device vdb from instance d9495878-bdc8-4448-9a96-a93168cca9dd from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:34:23 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:34:23 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:34:23 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:34:23 user nova-compute[80928]:   <serial>557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca</serial>
Nov 16 05:34:23 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 05:34:23 user nova-compute[80928]: </disk>
Nov 16 05:34:23 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:34:23 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Successfully detached device vdb from instance d9495878-bdc8-4448-9a96-a93168cca9dd from the persistent domain config.
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d9495878-bdc8-4448-9a96-a93168cca9dd from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:34:23 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:34:23 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:34:23 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:34:23 user nova-compute[80928]:   <serial>557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca</serial>
Nov 16 05:34:23 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 05:34:23 user nova-compute[80928]: </disk>
Nov 16 05:34:23 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f87663-4f1d-4869-9cd2-8f11af995c91]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfPUCdIV {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfPUCdIV" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[07574e78-ef11-43b5-9d85-fa40408f76e2]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pfPUCdIV'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[aced720c-a242-4d3d-ba94-ca0e2e80778c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e12f8e-3845-41f9-91c5-5dd43d626aed]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:23 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:23 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:23 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:23 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[db061624-7c98-47de-b53b-29e4cf0aec5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260]
Nov 16 05:34:23 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260] successful.
Nov 16 05:34:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea85a9fe-a2fc-4725-989d-5e45439add27]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0413943-ab86-4d3b-8503-bd450b07be73]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:24 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:24 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:24 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:24 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:24 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:24 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.424s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e665194f-c0fd-4761-bd56-34bae044b160]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfPUCdIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG nova.network.neutron [req-ecd2a977-97bb-4096-be34-23b8a2bd4c2b req-c84200fa-922b-4666-acfb-72641d0fc0d8 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updated VIF entry in instance network info cache for port 04d9eb71-77a9-453e-94e3-b5356df3a824. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG nova.network.neutron [req-ecd2a977-97bb-4096-be34-23b8a2bd4c2b req-c84200fa-922b-4666-acfb-72641d0fc0d8 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updating instance_info_cache with network_info: [{"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ecd2a977-97bb-4096-be34-23b8a2bd4c2b req-c84200fa-922b-4666-acfb-72641d0fc0d8 service nova] Releasing lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d9495878-bdc8-4448-9a96-a93168cca9dd {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '26434323838396139', 'path': '/dev/sde'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434323838396139', 'path': '/dev/sde'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1827874150',display_name='tempest-TestShelveInstance-server-1827874150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1827874150',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1824834473',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2bd17a971f5d4b00b634af7f34b14adc',ramdisk_id='',reservation_id='r-cdd685v9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-505947026',owner_user_name='tempest-TestShelveInstance-505947026-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:34:16Z,user_data=None,user_id='7f5ae21217cf4e70864e0331e403a82f',uuid=30c2bba7-99d9-4eea-8569-bf726c6ba2c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Converting VIF {"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.objects.instance [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lazy-loading 'pci_devices' on Instance uuid 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.objects.base [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Object Instance<30c2bba7-99d9-4eea-8569-bf726c6ba2c8> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:34:25 user nova-compute[80928]:   <uuid>30c2bba7-99d9-4eea-8569-bf726c6ba2c8</uuid>
Nov 16 05:34:25 user nova-compute[80928]:   <name>instance-0000000b</name>
Nov 16 05:34:25 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:34:25 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:34:25 user nova-compute[80928]:   <metadata>
Nov 16 05:34:25 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:34:25 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:34:25 user nova-compute[80928]:       <nova:name>tempest-TestShelveInstance-server-1827874150</nova:name>
Nov 16 05:34:25 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:34:23</nova:creationTime>
Nov 16 05:34:25 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:34:25 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:34:25 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:34:25 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:34:25 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:34:25 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:34:25 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:34:25 user nova-compute[80928]:       <nova:owner>
Nov 16 05:34:25 user nova-compute[80928]:         <nova:user uuid="7f5ae21217cf4e70864e0331e403a82f">tempest-TestShelveInstance-505947026-project-member</nova:user>
Nov 16 05:34:25 user nova-compute[80928]:         <nova:project uuid="2bd17a971f5d4b00b634af7f34b14adc">tempest-TestShelveInstance-505947026</nova:project>
Nov 16 05:34:25 user nova-compute[80928]:       </nova:owner>
Nov 16 05:34:25 user nova-compute[80928]:       <nova:ports>
Nov 16 05:34:25 user nova-compute[80928]:         <nova:port uuid="04d9eb71-77a9-453e-94e3-b5356df3a824">
Nov 16 05:34:25 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 05:34:25 user nova-compute[80928]:         </nova:port>
Nov 16 05:34:25 user nova-compute[80928]:       </nova:ports>
Nov 16 05:34:25 user nova-compute[80928]:     </nova:instance>
Nov 16 05:34:25 user nova-compute[80928]:   </metadata>
Nov 16 05:34:25 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:34:25 user nova-compute[80928]:     <system>
Nov 16 05:34:25 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:34:25 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:34:25 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:34:25 user nova-compute[80928]:       <entry name="serial">30c2bba7-99d9-4eea-8569-bf726c6ba2c8</entry>
Nov 16 05:34:25 user nova-compute[80928]:       <entry name="uuid">30c2bba7-99d9-4eea-8569-bf726c6ba2c8</entry>
Nov 16 05:34:25 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:34:25 user nova-compute[80928]:     </system>
Nov 16 05:34:25 user nova-compute[80928]:   </sysinfo>
Nov 16 05:34:25 user nova-compute[80928]:   <os>
Nov 16 05:34:25 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:34:25 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:34:25 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:34:25 user nova-compute[80928]:   </os>
Nov 16 05:34:25 user nova-compute[80928]:   <features>
Nov 16 05:34:25 user nova-compute[80928]:     <acpi/>
Nov 16 05:34:25 user nova-compute[80928]:     <apic/>
Nov 16 05:34:25 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:34:25 user nova-compute[80928]:   </features>
Nov 16 05:34:25 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:34:25 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:34:25 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:34:25 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:34:25 user nova-compute[80928]:   </clock>
Nov 16 05:34:25 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:34:25 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:34:25 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:34:25 user nova-compute[80928]:   </cpu>
Nov 16 05:34:25 user nova-compute[80928]:   <devices>
Nov 16 05:34:25 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:34:25 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:34:25 user nova-compute[80928]:       <source dev="/dev/sde"/>
Nov 16 05:34:25 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:34:25 user nova-compute[80928]:       <serial>f530422d-5a49-40b4-a9ce-6d67b438dac4</serial>
Nov 16 05:34:25 user nova-compute[80928]:     </disk>
Nov 16 05:34:25 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:34:25 user nova-compute[80928]:       <mac address="fa:16:3e:ad:86:90"/>
Nov 16 05:34:25 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:34:25 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:34:25 user nova-compute[80928]:       <target dev="tap04d9eb71-77"/>
Nov 16 05:34:25 user nova-compute[80928]:     </interface>
Nov 16 05:34:25 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:34:25 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/30c2bba7-99d9-4eea-8569-bf726c6ba2c8/console.log" append="off"/>
Nov 16 05:34:25 user nova-compute[80928]:     </serial>
Nov 16 05:34:25 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:34:25 user nova-compute[80928]:     <video>
Nov 16 05:34:25 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:34:25 user nova-compute[80928]:     </video>
Nov 16 05:34:25 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:34:25 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:34:25 user nova-compute[80928]:     </rng>
Nov 16 05:34:25 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:34:25 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:34:25 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:34:25 user nova-compute[80928]:     </memballoon>
Nov 16 05:34:25 user nova-compute[80928]:   </devices>
Nov 16 05:34:25 user nova-compute[80928]: </domain>
Nov 16 05:34:25 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1827874150',display_name='tempest-TestShelveInstance-server-1827874150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1827874150',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1824834473',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2bd17a971f5d4b00b634af7f34b14adc',ramdisk_id='',reservation_id='r-cdd685v9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-505947026',owner_user_name='tempest-TestShelveInstance-505947026-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:34:16Z,user_data=None,user_id='7f5ae21217cf4e70864e0331e403a82f',uuid=30c2bba7-99d9-4eea-8569-bf726c6ba2c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Converting VIF {"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_vif [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57a5e823-8c8d-52bd-854d-f81805e29e96', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04d9eb71-77, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04d9eb71-77, col_values=(('qos', UUID('6d772df9-0d01-4237-b3fc-a280777df267')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04d9eb71-77, col_values=(('external_ids', {'iface-id': '04d9eb71-77a9-453e-94e3-b5356df3a824', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:86:90', 'vm-uuid': '30c2bba7-99d9-4eea-8569-bf726c6ba2c8'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:25 user nova-compute[80928]: INFO os_vif [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77')
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] No VIF found with MAC fa:16:3e:ad:86:90, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:34:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Creating image(s)
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Ensure instance console log exists: /opt/stack/data/nova/instances/c7409e6d-ea55-41eb-8fab-9fd6a42d21cb/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Start _get_guest_xml network_info=[{"id": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "address": "fa:16:3e:5a:19:22", "network": {"id": "f1667eb3-5f9d-4355-9dad-a8703a9ad783", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213234258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9211fa0b-0c", "ovs_interfaceid": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9818988-0285-454f-8f12-52d9203cc9ea", "address": "fa:16:3e:8d:38:fe", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9818988-02", "ovs_interfaceid": "d9818988-0285-454f-8f12-52d9203cc9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "address": "fa:16:3e:fb:ef:67", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664f643e-40", "ovs_interfaceid": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "address": "fa:16:3e:e1:66:8d", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9bc7ae-c5", "ovs_interfaceid": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "address": "fa:16:3e:b1:8b:be", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ed7dc5-8a", "ovs_interfaceid": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "address": "fa:16:3e:90:82:99", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dc6d2a-f0", "ovs_interfaceid": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "address": "fa:16:3e:0e:0b:f3", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26dc4cc-11", "ovs_interfaceid": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfCFabUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7409e6d-ea55-41eb-8fab-9fd6a42d21cb', 'attached_at': '', 'detached_at': '', 'volume_id': '13c848a4-ab88-4cd2-a8fc-302d836528b0', 'serial': '13c848a4-ab88-4cd2-a8fc-302d836528b0'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '60151c00-857b-45fe-941f-81cd64555a87', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfdbSRou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7409e6d-ea55-41eb-8fab-9fd6a42d21cb', 'attached_at': '', 'detached_at': '', 'volume_id': '09dfc924-be3b-4968-b87f-fd18cb353ff6', 'serial': '09dfc924-be3b-4968-b87f-fd18cb353ff6'}, 'boot_index': 1, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c8ebffa2-e6df-4ee6-90e5-8be60584fa91', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnBDUzCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7409e6d-ea55-41eb-8fab-9fd6a42d21cb', 'attached_at': '', 'detached_at': '', 'volume_id': '3151297c-1f63-431d-bc0b-f9f6e45dacd0', 'serial': '3151297c-1f63-431d-bc0b-f9f6e45dacd0'}, 'boot_index': 2, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '6cd19923-50ce-473b-9329-819c2bc127f2', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:25 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:34:25 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfCFabUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:25 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:25 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:25 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9868ad-c1d1-4cae-bb1d-e4e563b9617a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:34:25 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d463bf-af7b-42af-b35a-127207dec84e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0] added
Nov 16 05:34:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[431bddee-5d33-463b-9d41-8303d3940157]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea97509e-439f-4874-b45e-873fae4411d1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfCFabUs {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfCFabUs" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41c188d-61a2-4214-a572-67e19b9575ab]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KfCFabUs'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[194667db-3b29-4df5-960c-02f7c1159664]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30448b1-11c4-4df8-9951-f3d5e52a49af]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[00beddfa-4afe-4825-990e-5c80fdc1a6ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0, portal: 172.16.0.220,3260]
Nov 16 05:34:25 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0, portal: 172.16.0.220,3260] successful.
Nov 16 05:34:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8a9402-cf9f-48bf-bde3-0b0b90207437]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ee8957-6f96-402f-b669-279362ff6da5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02dd5fd-26a9-4220-a48e-37638e63b6b2]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:34:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfCFabUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23834383661316131', 'path': '/dev/sdf'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834383661316131', 'path': '/dev/sdf'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfdbSRou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:26 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:26 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:26 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fe5f6e-cf85-4a88-a555-a27e2c7c7ce0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:34:26 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4decb9f-fb8d-4689-9e80-bb40c31a253b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6] added
Nov 16 05:34:26 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77b42db-e6a4-4e3a-a08d-f181c718f539]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[919d8386-897c-4895-8388-bf51d647df23]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfdbSRou {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfdbSRou" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eccc7c-b8a5-4902-928d-e5bbbe913de7]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kfdbSRou'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-bc2ca65f-ae00-4326-a11b-d99ffddbb9fd req-3a266bb6-a48c-4e5a-9c56-6e6ddc522398 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bc2ca65f-ae00-4326-a11b-d99ffddbb9fd req-3a266bb6-a48c-4e5a-9c56-6e6ddc522398 service nova] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bc2ca65f-ae00-4326-a11b-d99ffddbb9fd req-3a266bb6-a48c-4e5a-9c56-6e6ddc522398 service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bc2ca65f-ae00-4326-a11b-d99ffddbb9fd req-3a266bb6-a48c-4e5a-9c56-6e6ddc522398 service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-bc2ca65f-ae00-4326-a11b-d99ffddbb9fd req-3a266bb6-a48c-4e5a-9c56-6e6ddc522398 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] No waiting events found dispatching network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:26 user nova-compute[80928]: WARNING nova.compute.manager [req-bc2ca65f-ae00-4326-a11b-d99ffddbb9fd req-3a266bb6-a48c-4e5a-9c56-6e6ddc522398 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received unexpected event network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3fd3f5-009e-4806-9044-fa26895f277c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d86dee2-16d0-40f5-9f25-99f6e1f9f0a4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:26 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:26 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:26 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:26 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:26 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:26 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:26 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:26 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:26 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:26 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b19f8dc-1800-44c1-9126-a4b7f6e1eab7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6, portal: 172.16.0.220,3260]
Nov 16 05:34:27 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6, portal: 172.16.0.220,3260] successful.
Nov 16 05:34:27 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[50658359-6da1-4d19-ae1a-42909498effb]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef83591a-b37c-41bd-9003-8b214594cb81]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:27 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:27 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:27 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:27 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:27 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:27 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:27 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:27 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:27 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:27 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:27 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:27 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a3a855-505c-4c9a-880d-95c922de80c6]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfdbSRou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:34:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23563633062386537', 'path': '/dev/sdg'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563633062386537', 'path': '/dev/sdg'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnBDUzCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:28 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:28 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:28 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e079d58-ebd0-44e9-b8a8-4c1818f60d3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:34:28 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e1f33a-09ea-433a-b0ca-9a2ee7d20605]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0] added
Nov 16 05:34:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9d4606-f1e3-497f-adf0-c4d2d028ea64]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f591cc9-f955-400a-921a-89c789e100f5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnBDUzCl {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnBDUzCl" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b64d30b-0ab9-4c00-b612-dccc09d0e49e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mnBDUzCl'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33f5b47-2c2d-49fc-bfe5-d203f78cb4fd]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb94416-780b-4806-9365-75e3691bcf88]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[01356648-49b3-43cd-bdb4-ba4567abedce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0, portal: 172.16.0.220,3260]
Nov 16 05:34:28 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0, portal: 172.16.0.220,3260] successful.
Nov 16 05:34:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c92cf46-a38d-4b81-b00e-819bf365ce36]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[57de43ce-ba38-48c7-a9e4-8b0d9db96fb1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22fda9d-8b87-4f7c-8641-e1d25f330901]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG nova.compute.manager [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:34:28 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Instance spawned successfully.
Nov 16 05:34:28 user nova-compute[80928]: DEBUG nova.compute.manager [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-67951bd7-c9d9-42c3-93cf-fe43486a4df6 tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.970s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-c027894f-da27-4446-9fd6-cb5f97ff0734 req-7a93ffb3-b32a-4942-83d5-ff481e594d25 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c027894f-da27-4446-9fd6-cb5f97ff0734 req-7a93ffb3-b32a-4942-83d5-ff481e594d25 service nova] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c027894f-da27-4446-9fd6-cb5f97ff0734 req-7a93ffb3-b32a-4942-83d5-ff481e594d25 service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c027894f-da27-4446-9fd6-cb5f97ff0734 req-7a93ffb3-b32a-4942-83d5-ff481e594d25 service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-c027894f-da27-4446-9fd6-cb5f97ff0734 req-7a93ffb3-b32a-4942-83d5-ff481e594d25 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] No waiting events found dispatching network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:28 user nova-compute[80928]: WARNING nova.compute.manager [req-c027894f-da27-4446-9fd6-cb5f97ff0734 req-7a93ffb3-b32a-4942-83d5-ff481e594d25 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received unexpected event network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 for instance with vm_state active and task_state None.
Nov 16 05:34:29 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnBDUzCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23038313239393061', 'path': '/dev/sdh'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038313239393061', 'path': '/dev/sdh'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "address": "fa:16:3e:5a:19:22", "network": {"id": "f1667eb3-5f9d-4355-9dad-a8703a9ad783", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213234258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9211fa0b-0c", "ovs_interfaceid": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "address": "fa:16:3e:5a:19:22", "network": {"id": "f1667eb3-5f9d-4355-9dad-a8703a9ad783", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213234258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9211fa0b-0c", "ovs_interfaceid": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:19:22,bridge_name='br-int',has_traffic_filtering=True,id=9211fa0b-0cf5-455a-b696-a6bd23bb2f8b,network=Network(f1667eb3-5f9d-4355-9dad-a8703a9ad783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9211fa0b-0c') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9818988-0285-454f-8f12-52d9203cc9ea", "address": "fa:16:3e:8d:38:fe", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9818988-02", "ovs_interfaceid": "d9818988-0285-454f-8f12-52d9203cc9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "d9818988-0285-454f-8f12-52d9203cc9ea", "address": "fa:16:3e:8d:38:fe", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9818988-02", "ovs_interfaceid": "d9818988-0285-454f-8f12-52d9203cc9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:38:fe,bridge_name='br-int',has_traffic_filtering=True,id=d9818988-0285-454f-8f12-52d9203cc9ea,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd9818988-02') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "address": "fa:16:3e:fb:ef:67", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664f643e-40", "ovs_interfaceid": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "address": "fa:16:3e:fb:ef:67", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664f643e-40", "ovs_interfaceid": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:67,bridge_name='br-int',has_traffic_filtering=True,id=664f643e-408b-4ebe-b6f3-4c8c2dc908de,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap664f643e-40') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "address": "fa:16:3e:e1:66:8d", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9bc7ae-c5", "ovs_interfaceid": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "address": "fa:16:3e:e1:66:8d", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9bc7ae-c5", "ovs_interfaceid": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:66:8d,bridge_name='br-int',has_traffic_filtering=True,id=cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9bc7ae-c5') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "address": "fa:16:3e:b1:8b:be", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ed7dc5-8a", "ovs_interfaceid": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "address": "fa:16:3e:b1:8b:be", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ed7dc5-8a", "ovs_interfaceid": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=82ed7dc5-8a5c-4283-acdc-1936c1af2011,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ed7dc5-8a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "address": "fa:16:3e:90:82:99", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dc6d2a-f0", "ovs_interfaceid": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "address": "fa:16:3e:90:82:99", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dc6d2a-f0", "ovs_interfaceid": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:82:99,bridge_name='br-int',has_traffic_filtering=True,id=52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dc6d2a-f0') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "address": "fa:16:3e:0e:0b:f3", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26dc4cc-11", "ovs_interfaceid": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "address": "fa:16:3e:0e:0b:f3", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26dc4cc-11", "ovs_interfaceid": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:0b:f3,bridge_name='br-int',has_traffic_filtering=True,id=c26dc4cc-11a1-42fb-ab32-1b712ed83ecb,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26dc4cc-11') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.objects.instance [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lazy-loading 'pci_devices' on Instance uuid c7409e6d-ea55-41eb-8fab-9fd6a42d21cb {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:34:29 user nova-compute[80928]:   <uuid>c7409e6d-ea55-41eb-8fab-9fd6a42d21cb</uuid>
Nov 16 05:34:29 user nova-compute[80928]:   <name>instance-00000015</name>
Nov 16 05:34:29 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:34:29 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:34:29 user nova-compute[80928]:   <metadata>
Nov 16 05:34:29 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:34:29 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:34:29 user nova-compute[80928]:       <nova:name>tempest-device-tagging-server-351310027</nova:name>
Nov 16 05:34:29 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:34:25</nova:creationTime>
Nov 16 05:34:29 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:34:29 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:34:29 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:34:29 user nova-compute[80928]:       <nova:owner>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:user uuid="e6e814096e334600bcfda87d6fd8cb0b">tempest-TaggedBootDevicesTest-2010731434-project-member</nova:user>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:project uuid="4d0b8244c3134053b614616307802f35">tempest-TaggedBootDevicesTest-2010731434</nova:project>
Nov 16 05:34:29 user nova-compute[80928]:       </nova:owner>
Nov 16 05:34:29 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:34:29 user nova-compute[80928]:       <nova:ports>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:port uuid="9211fa0b-0cf5-455a-b696-a6bd23bb2f8b">
Nov 16 05:34:29 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 05:34:29 user nova-compute[80928]:         </nova:port>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:port uuid="d9818988-0285-454f-8f12-52d9203cc9ea">
Nov 16 05:34:29 user nova-compute[80928]:           <nova:ip type="fixed" address="10.1.1.111" ipVersion="4"/>
Nov 16 05:34:29 user nova-compute[80928]:         </nova:port>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:port uuid="664f643e-408b-4ebe-b6f3-4c8c2dc908de">
Nov 16 05:34:29 user nova-compute[80928]:           <nova:ip type="fixed" address="10.1.1.174" ipVersion="4"/>
Nov 16 05:34:29 user nova-compute[80928]:         </nova:port>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:port uuid="cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b">
Nov 16 05:34:29 user nova-compute[80928]:           <nova:ip type="fixed" address="10.1.1.63" ipVersion="4"/>
Nov 16 05:34:29 user nova-compute[80928]:         </nova:port>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:port uuid="82ed7dc5-8a5c-4283-acdc-1936c1af2011">
Nov 16 05:34:29 user nova-compute[80928]:           <nova:ip type="fixed" address="10.1.1.186" ipVersion="4"/>
Nov 16 05:34:29 user nova-compute[80928]:         </nova:port>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:port uuid="52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2">
Nov 16 05:34:29 user nova-compute[80928]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 05:34:29 user nova-compute[80928]:         </nova:port>
Nov 16 05:34:29 user nova-compute[80928]:         <nova:port uuid="c26dc4cc-11a1-42fb-ab32-1b712ed83ecb">
Nov 16 05:34:29 user nova-compute[80928]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 05:34:29 user nova-compute[80928]:         </nova:port>
Nov 16 05:34:29 user nova-compute[80928]:       </nova:ports>
Nov 16 05:34:29 user nova-compute[80928]:     </nova:instance>
Nov 16 05:34:29 user nova-compute[80928]:   </metadata>
Nov 16 05:34:29 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:34:29 user nova-compute[80928]:     <system>
Nov 16 05:34:29 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:34:29 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:34:29 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:34:29 user nova-compute[80928]:       <entry name="serial">c7409e6d-ea55-41eb-8fab-9fd6a42d21cb</entry>
Nov 16 05:34:29 user nova-compute[80928]:       <entry name="uuid">c7409e6d-ea55-41eb-8fab-9fd6a42d21cb</entry>
Nov 16 05:34:29 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:34:29 user nova-compute[80928]:     </system>
Nov 16 05:34:29 user nova-compute[80928]:   </sysinfo>
Nov 16 05:34:29 user nova-compute[80928]:   <os>
Nov 16 05:34:29 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:34:29 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:34:29 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:34:29 user nova-compute[80928]:   </os>
Nov 16 05:34:29 user nova-compute[80928]:   <features>
Nov 16 05:34:29 user nova-compute[80928]:     <acpi/>
Nov 16 05:34:29 user nova-compute[80928]:     <apic/>
Nov 16 05:34:29 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:34:29 user nova-compute[80928]:   </features>
Nov 16 05:34:29 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:34:29 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:34:29 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:34:29 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:34:29 user nova-compute[80928]:   </clock>
Nov 16 05:34:29 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:34:29 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:34:29 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:34:29 user nova-compute[80928]:   </cpu>
Nov 16 05:34:29 user nova-compute[80928]:   <devices>
Nov 16 05:34:29 user nova-compute[80928]:     <disk type="file" device="cdrom">
Nov 16 05:34:29 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 05:34:29 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/c7409e6d-ea55-41eb-8fab-9fd6a42d21cb/disk.config"/>
Nov 16 05:34:29 user nova-compute[80928]:       <target dev="hda" bus="ide"/>
Nov 16 05:34:29 user nova-compute[80928]:     </disk>
Nov 16 05:34:29 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:34:29 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:34:29 user nova-compute[80928]:       <source dev="/dev/sdf"/>
Nov 16 05:34:29 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:34:29 user nova-compute[80928]:       <serial>13c848a4-ab88-4cd2-a8fc-302d836528b0</serial>
Nov 16 05:34:29 user nova-compute[80928]:     </disk>
Nov 16 05:34:29 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:34:29 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:34:29 user nova-compute[80928]:       <source dev="/dev/sdg"/>
Nov 16 05:34:29 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:34:29 user nova-compute[80928]:       <serial>09dfc924-be3b-4968-b87f-fd18cb353ff6</serial>
Nov 16 05:34:29 user nova-compute[80928]:     </disk>
Nov 16 05:34:29 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:34:29 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:34:29 user nova-compute[80928]:       <source dev="/dev/sdh"/>
Nov 16 05:34:29 user nova-compute[80928]:       <target dev="vdc" bus="virtio"/>
Nov 16 05:34:29 user nova-compute[80928]:       <serial>3151297c-1f63-431d-bc0b-f9f6e45dacd0</serial>
Nov 16 05:34:29 user nova-compute[80928]:     </disk>
Nov 16 05:34:29 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:34:29 user nova-compute[80928]:       <mac address="fa:16:3e:5a:19:22"/>
Nov 16 05:34:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:34:29 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:34:29 user nova-compute[80928]:       <target dev="tap9211fa0b-0c"/>
Nov 16 05:34:29 user nova-compute[80928]:     </interface>
Nov 16 05:34:29 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:34:29 user nova-compute[80928]:       <mac address="fa:16:3e:8d:38:fe"/>
Nov 16 05:34:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:34:29 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:34:29 user nova-compute[80928]:       <target dev="tapd9818988-02"/>
Nov 16 05:34:29 user nova-compute[80928]:     </interface>
Nov 16 05:34:29 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:34:29 user nova-compute[80928]:       <mac address="fa:16:3e:fb:ef:67"/>
Nov 16 05:34:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:34:29 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:34:29 user nova-compute[80928]:       <target dev="tap664f643e-40"/>
Nov 16 05:34:29 user nova-compute[80928]:     </interface>
Nov 16 05:34:29 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:34:29 user nova-compute[80928]:       <mac address="fa:16:3e:e1:66:8d"/>
Nov 16 05:34:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:34:29 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:34:29 user nova-compute[80928]:       <target dev="tapcc9bc7ae-c5"/>
Nov 16 05:34:29 user nova-compute[80928]:     </interface>
Nov 16 05:34:29 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:34:29 user nova-compute[80928]:       <mac address="fa:16:3e:b1:8b:be"/>
Nov 16 05:34:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:34:29 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:34:29 user nova-compute[80928]:       <target dev="tap82ed7dc5-8a"/>
Nov 16 05:34:29 user nova-compute[80928]:     </interface>
Nov 16 05:34:29 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:34:29 user nova-compute[80928]:       <mac address="fa:16:3e:90:82:99"/>
Nov 16 05:34:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:34:29 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:34:29 user nova-compute[80928]:       <target dev="tap52dc6d2a-f0"/>
Nov 16 05:34:29 user nova-compute[80928]:     </interface>
Nov 16 05:34:29 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:34:29 user nova-compute[80928]:       <mac address="fa:16:3e:0e:0b:f3"/>
Nov 16 05:34:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:34:29 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:34:29 user nova-compute[80928]:       <target dev="tapc26dc4cc-11"/>
Nov 16 05:34:29 user nova-compute[80928]:     </interface>
Nov 16 05:34:29 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:34:29 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/c7409e6d-ea55-41eb-8fab-9fd6a42d21cb/console.log" append="off"/>
Nov 16 05:34:29 user nova-compute[80928]:     </serial>
Nov 16 05:34:29 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:34:29 user nova-compute[80928]:     <video>
Nov 16 05:34:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:34:29 user nova-compute[80928]:     </video>
Nov 16 05:34:29 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:34:29 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:34:29 user nova-compute[80928]:     </rng>
Nov 16 05:34:29 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:34:29 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:34:29 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:34:29 user nova-compute[80928]:     </memballoon>
Nov 16 05:34:29 user nova-compute[80928]:   </devices>
Nov 16 05:34:29 user nova-compute[80928]: </domain>
Nov 16 05:34:29 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "address": "fa:16:3e:5a:19:22", "network": {"id": "f1667eb3-5f9d-4355-9dad-a8703a9ad783", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213234258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9211fa0b-0c", "ovs_interfaceid": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "address": "fa:16:3e:5a:19:22", "network": {"id": "f1667eb3-5f9d-4355-9dad-a8703a9ad783", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213234258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9211fa0b-0c", "ovs_interfaceid": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:19:22,bridge_name='br-int',has_traffic_filtering=True,id=9211fa0b-0cf5-455a-b696-a6bd23bb2f8b,network=Network(f1667eb3-5f9d-4355-9dad-a8703a9ad783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9211fa0b-0c') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:19:22,bridge_name='br-int',has_traffic_filtering=True,id=9211fa0b-0cf5-455a-b696-a6bd23bb2f8b,network=Network(f1667eb3-5f9d-4355-9dad-a8703a9ad783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9211fa0b-0c') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '779ee086-609b-5334-aa25-d362f77b204f', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9211fa0b-0c, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9211fa0b-0c, col_values=(('qos', UUID('e5b28694-6e0d-49a0-a365-c44d528a26cf')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9211fa0b-0c, col_values=(('external_ids', {'iface-id': '9211fa0b-0cf5-455a-b696-a6bd23bb2f8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:19:22', 'vm-uuid': 'c7409e6d-ea55-41eb-8fab-9fd6a42d21cb'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: INFO os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:19:22,bridge_name='br-int',has_traffic_filtering=True,id=9211fa0b-0cf5-455a-b696-a6bd23bb2f8b,network=Network(f1667eb3-5f9d-4355-9dad-a8703a9ad783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9211fa0b-0c')
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9818988-0285-454f-8f12-52d9203cc9ea", "address": "fa:16:3e:8d:38:fe", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9818988-02", "ovs_interfaceid": "d9818988-0285-454f-8f12-52d9203cc9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "d9818988-0285-454f-8f12-52d9203cc9ea", "address": "fa:16:3e:8d:38:fe", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9818988-02", "ovs_interfaceid": "d9818988-0285-454f-8f12-52d9203cc9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:38:fe,bridge_name='br-int',has_traffic_filtering=True,id=d9818988-0285-454f-8f12-52d9203cc9ea,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd9818988-02') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:38:fe,bridge_name='br-int',has_traffic_filtering=True,id=d9818988-0285-454f-8f12-52d9203cc9ea,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd9818988-02') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4923945-3bf1-5db9-b8c9-a71add942299', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9818988-02, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9818988-02, col_values=(('qos', UUID('a300979d-4dfc-464a-8f2a-673f83130652')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9818988-02, col_values=(('external_ids', {'iface-id': 'd9818988-0285-454f-8f12-52d9203cc9ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:38:fe', 'vm-uuid': 'c7409e6d-ea55-41eb-8fab-9fd6a42d21cb'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: INFO os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:38:fe,bridge_name='br-int',has_traffic_filtering=True,id=d9818988-0285-454f-8f12-52d9203cc9ea,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd9818988-02')
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "address": "fa:16:3e:fb:ef:67", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664f643e-40", "ovs_interfaceid": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "address": "fa:16:3e:fb:ef:67", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664f643e-40", "ovs_interfaceid": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:67,bridge_name='br-int',has_traffic_filtering=True,id=664f643e-408b-4ebe-b6f3-4c8c2dc908de,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap664f643e-40') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:67,bridge_name='br-int',has_traffic_filtering=True,id=664f643e-408b-4ebe-b6f3-4c8c2dc908de,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap664f643e-40') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4877b48b-f8b2-54e3-81b0-95b175a225b0', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap664f643e-40, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap664f643e-40, col_values=(('qos', UUID('d5b094e6-c397-4c0b-9490-bd8a0952f6d2')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap664f643e-40, col_values=(('external_ids', {'iface-id': '664f643e-408b-4ebe-b6f3-4c8c2dc908de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:ef:67', 'vm-uuid': 'c7409e6d-ea55-41eb-8fab-9fd6a42d21cb'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: INFO os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:67,bridge_name='br-int',has_traffic_filtering=True,id=664f643e-408b-4ebe-b6f3-4c8c2dc908de,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap664f643e-40')
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "address": "fa:16:3e:e1:66:8d", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9bc7ae-c5", "ovs_interfaceid": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "address": "fa:16:3e:e1:66:8d", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9bc7ae-c5", "ovs_interfaceid": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:66:8d,bridge_name='br-int',has_traffic_filtering=True,id=cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9bc7ae-c5') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:66:8d,bridge_name='br-int',has_traffic_filtering=True,id=cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9bc7ae-c5') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0284c294-c4f8-53ea-8ac4-5bb54ed44731', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc9bc7ae-c5, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc9bc7ae-c5, col_values=(('qos', UUID('13fe5a04-5e90-48b6-b943-0c583a4651b8')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc9bc7ae-c5, col_values=(('external_ids', {'iface-id': 'cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:66:8d', 'vm-uuid': 'c7409e6d-ea55-41eb-8fab-9fd6a42d21cb'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: INFO os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:66:8d,bridge_name='br-int',has_traffic_filtering=True,id=cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9bc7ae-c5')
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "address": "fa:16:3e:b1:8b:be", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ed7dc5-8a", "ovs_interfaceid": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "address": "fa:16:3e:b1:8b:be", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ed7dc5-8a", "ovs_interfaceid": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=82ed7dc5-8a5c-4283-acdc-1936c1af2011,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ed7dc5-8a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=82ed7dc5-8a5c-4283-acdc-1936c1af2011,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ed7dc5-8a') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87db6f3d-281a-5932-bdcd-bac309a084d9', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82ed7dc5-8a, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82ed7dc5-8a, col_values=(('qos', UUID('97494994-28e0-4dea-a9ab-84be8dda7253')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82ed7dc5-8a, col_values=(('external_ids', {'iface-id': '82ed7dc5-8a5c-4283-acdc-1936c1af2011', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:8b:be', 'vm-uuid': 'c7409e6d-ea55-41eb-8fab-9fd6a42d21cb'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: INFO os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=82ed7dc5-8a5c-4283-acdc-1936c1af2011,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ed7dc5-8a')
Nov 16 05:34:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "address": "fa:16:3e:90:82:99", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dc6d2a-f0", "ovs_interfaceid": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "address": "fa:16:3e:90:82:99", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dc6d2a-f0", "ovs_interfaceid": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:82:99,bridge_name='br-int',has_traffic_filtering=True,id=52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dc6d2a-f0') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:82:99,bridge_name='br-int',has_traffic_filtering=True,id=52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dc6d2a-f0') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e168674-ef19-5a6a-88d6-586b55cedbdc', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52dc6d2a-f0, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52dc6d2a-f0, col_values=(('qos', UUID('6d890761-0cca-4e39-8271-84a781a22f29')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52dc6d2a-f0, col_values=(('external_ids', {'iface-id': '52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:82:99', 'vm-uuid': 'c7409e6d-ea55-41eb-8fab-9fd6a42d21cb'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: INFO os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:82:99,bridge_name='br-int',has_traffic_filtering=True,id=52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dc6d2a-f0')
Nov 16 05:34:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "address": "fa:16:3e:0e:0b:f3", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26dc4cc-11", "ovs_interfaceid": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "address": "fa:16:3e:0e:0b:f3", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26dc4cc-11", "ovs_interfaceid": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:0b:f3,bridge_name='br-int',has_traffic_filtering=True,id=c26dc4cc-11a1-42fb-ab32-1b712ed83ecb,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26dc4cc-11') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:0b:f3,bridge_name='br-int',has_traffic_filtering=True,id=c26dc4cc-11a1-42fb-ab32-1b712ed83ecb,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26dc4cc-11') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4773b35-6f71-598e-bd79-0ad417667e8b', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc26dc4cc-11, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc26dc4cc-11, col_values=(('qos', UUID('9d5f7dfe-778d-484e-a0c1-b84abf8dc977')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc26dc4cc-11, col_values=(('external_ids', {'iface-id': 'c26dc4cc-11a1-42fb-ab32-1b712ed83ecb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:0b:f3', 'vm-uuid': 'c7409e6d-ea55-41eb-8fab-9fd6a42d21cb'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: INFO os_vif [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:0b:f3,bridge_name='br-int',has_traffic_filtering=True,id=c26dc4cc-11a1-42fb-ab32-1b712ed83ecb,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26dc4cc-11')
Nov 16 05:34:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] No BDM found with device name hda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] No BDM found with device name vdc, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] No VIF found with MAC fa:16:3e:5a:19:22, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] No VIF found with MAC fa:16:3e:b1:8b:be, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:34:30 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Using config drive
Nov 16 05:34:30 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Creating config drive at /opt/stack/data/nova/instances/c7409e6d-ea55-41eb-8fab-9fd6a42d21cb/disk.config
Nov 16 05:34:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c7409e6d-ea55-41eb-8fab-9fd6a42d21cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwh9gctex {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c7409e6d-ea55-41eb-8fab-9fd6a42d21cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwh9gctex" returned: 0 in 0.066s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-af687767-958b-461b-a036-1ac345160383 req-acb16a7a-4e31-4f9e-869c-26d5f842c946 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-af687767-958b-461b-a036-1ac345160383 req-acb16a7a-4e31-4f9e-869c-26d5f842c946 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-af687767-958b-461b-a036-1ac345160383 req-acb16a7a-4e31-4f9e-869c-26d5f842c946 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-af687767-958b-461b-a036-1ac345160383 req-acb16a7a-4e31-4f9e-869c-26d5f842c946 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-af687767-958b-461b-a036-1ac345160383 req-acb16a7a-4e31-4f9e-869c-26d5f842c946 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:32 user nova-compute[80928]: WARNING nova.compute.manager [req-af687767-958b-461b-a036-1ac345160383 req-acb16a7a-4e31-4f9e-869c-26d5f842c946 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b for instance with vm_state building and task_state spawning.
Nov 16 05:34:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-39decbe2-4a2f-4368-8468-378ef18b80d8 req-92115cf6-f114-4218-8792-eb6b7b59e4a1 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-d9818988-0285-454f-8f12-52d9203cc9ea {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-39decbe2-4a2f-4368-8468-378ef18b80d8 req-92115cf6-f114-4218-8792-eb6b7b59e4a1 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-39decbe2-4a2f-4368-8468-378ef18b80d8 req-92115cf6-f114-4218-8792-eb6b7b59e4a1 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-39decbe2-4a2f-4368-8468-378ef18b80d8 req-92115cf6-f114-4218-8792-eb6b7b59e4a1 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-39decbe2-4a2f-4368-8468-378ef18b80d8 req-92115cf6-f114-4218-8792-eb6b7b59e4a1 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-d9818988-0285-454f-8f12-52d9203cc9ea {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:33 user nova-compute[80928]: WARNING nova.compute.manager [req-39decbe2-4a2f-4368-8468-378ef18b80d8 req-92115cf6-f114-4218-8792-eb6b7b59e4a1 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-d9818988-0285-454f-8f12-52d9203cc9ea for instance with vm_state building and task_state spawning.
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:34 user nova-compute[80928]: WARNING nova.compute.manager [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b for instance with vm_state building and task_state spawning.
Nov 16 05:34:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:34 user nova-compute[80928]: WARNING nova.compute.manager [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-82ed7dc5-8a5c-4283-acdc-1936c1af2011 for instance with vm_state building and task_state spawning.
Nov 16 05:34:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:34 user nova-compute[80928]: WARNING nova.compute.manager [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-82ed7dc5-8a5c-4283-acdc-1936c1af2011 for instance with vm_state building and task_state spawning.
Nov 16 05:34:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:34 user nova-compute[80928]: WARNING nova.compute.manager [req-5ec2743f-1a2a-4e6a-a1a7-9f5d35d1ed1f req-810dabe6-62d6-4ab3-98a0-c18005328813 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb for instance with vm_state building and task_state spawning.
Nov 16 05:34:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-d9818988-0285-454f-8f12-52d9203cc9ea {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-d9818988-0285-454f-8f12-52d9203cc9ea {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:35 user nova-compute[80928]: WARNING nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-d9818988-0285-454f-8f12-52d9203cc9ea for instance with vm_state building and task_state spawning.
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-664f643e-408b-4ebe-b6f3-4c8c2dc908de {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-664f643e-408b-4ebe-b6f3-4c8c2dc908de {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:35 user nova-compute[80928]: WARNING nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-664f643e-408b-4ebe-b6f3-4c8c2dc908de for instance with vm_state building and task_state spawning.
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-664f643e-408b-4ebe-b6f3-4c8c2dc908de {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-664f643e-408b-4ebe-b6f3-4c8c2dc908de {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:35 user nova-compute[80928]: WARNING nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-664f643e-408b-4ebe-b6f3-4c8c2dc908de for instance with vm_state building and task_state spawning.
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:35 user nova-compute[80928]: WARNING nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b for instance with vm_state building and task_state spawning.
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:35 user nova-compute[80928]: WARNING nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b for instance with vm_state building and task_state spawning.
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:35 user nova-compute[80928]: WARNING nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 for instance with vm_state building and task_state spawning.
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:35 user nova-compute[80928]: WARNING nova.compute.manager [req-6863208f-8cac-4982-b6fc-fabb3c219e7f req-29315105-6be6-45fd-a2d1-6bd866cdb0f7 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 for instance with vm_state building and task_state spawning.
Nov 16 05:34:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:34:36 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Instance spawned successfully.
Nov 16 05:34:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:34:36 user nova-compute[80928]: INFO nova.compute.manager [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Took 11.41 seconds to spawn the instance on the hypervisor.
Nov 16 05:34:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG nova.compute.manager [req-2b22f3af-98cc-4bd7-93be-508062951d12 req-94cdcafa-d6f4-4225-9ab1-8cfe54c83fac service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2b22f3af-98cc-4bd7-93be-508062951d12 req-94cdcafa-d6f4-4225-9ab1-8cfe54c83fac service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2b22f3af-98cc-4bd7-93be-508062951d12 req-94cdcafa-d6f4-4225-9ab1-8cfe54c83fac service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2b22f3af-98cc-4bd7-93be-508062951d12 req-94cdcafa-d6f4-4225-9ab1-8cfe54c83fac service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:36 user nova-compute[80928]: DEBUG nova.compute.manager [req-2b22f3af-98cc-4bd7-93be-508062951d12 req-94cdcafa-d6f4-4225-9ab1-8cfe54c83fac service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:36 user nova-compute[80928]: WARNING nova.compute.manager [req-2b22f3af-98cc-4bd7-93be-508062951d12 req-94cdcafa-d6f4-4225-9ab1-8cfe54c83fac service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb for instance with vm_state building and task_state spawning.
Nov 16 05:34:36 user nova-compute[80928]: INFO nova.compute.manager [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Took 30.13 seconds to build instance.
Nov 16 05:34:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-31c6c195-d78d-4435-a4ff-9317f449e563 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.279s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-7917a59d-7b46-45a5-b44c-100667e76c83 req-f66a87d0-452f-4236-9038-8ae516739cb0 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received event network-changed-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-7917a59d-7b46-45a5-b44c-100667e76c83 req-f66a87d0-452f-4236-9038-8ae516739cb0 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Refreshing instance network info cache due to event network-changed-810ff4e6-46ca-448f-ba1c-047dc5db6d75. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7917a59d-7b46-45a5-b44c-100667e76c83 req-f66a87d0-452f-4236-9038-8ae516739cb0 service nova] Acquiring lock "refresh_cache-859f06da-737e-40c3-9e85-2fd33052a9ea" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7917a59d-7b46-45a5-b44c-100667e76c83 req-f66a87d0-452f-4236-9038-8ae516739cb0 service nova] Acquired lock "refresh_cache-859f06da-737e-40c3-9e85-2fd33052a9ea" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG nova.network.neutron [req-7917a59d-7b46-45a5-b44c-100667e76c83 req-f66a87d0-452f-4236-9038-8ae516739cb0 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Refreshing network info cache for port 810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:40 user nova-compute[80928]: INFO nova.compute.manager [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Terminating instance
Nov 16 05:34:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lazy-loading 'flavor' on Instance uuid 859f06da-737e-40c3-9e85-2fd33052a9ea {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:41 user nova-compute[80928]: INFO nova.compute.manager [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Attaching volume 5ca704f9-941d-4088-80bc-d998989f18c0 to /dev/vdb
Nov 16 05:34:41 user nova-compute[80928]: DEBUG nova.network.neutron [req-7917a59d-7b46-45a5-b44c-100667e76c83 req-f66a87d0-452f-4236-9038-8ae516739cb0 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Updated VIF entry in instance network info cache for port 810ff4e6-46ca-448f-ba1c-047dc5db6d75. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG nova.network.neutron [req-7917a59d-7b46-45a5-b44c-100667e76c83 req-f66a87d0-452f-4236-9038-8ae516739cb0 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Updating instance_info_cache with network_info: [{"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7917a59d-7b46-45a5-b44c-100667e76c83 req-f66a87d0-452f-4236-9038-8ae516739cb0 service nova] Releasing lock "refresh_cache-859f06da-737e-40c3-9e85-2fd33052a9ea" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-ea23b626-1603-458e-b488-84a9e27efa8b req-ece1ad71-4adb-457c-a64a-f8f243d8d96d service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Received event network-vif-unplugged-5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ea23b626-1603-458e-b488-84a9e27efa8b req-ece1ad71-4adb-457c-a64a-f8f243d8d96d service nova] Acquiring lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ea23b626-1603-458e-b488-84a9e27efa8b req-ece1ad71-4adb-457c-a64a-f8f243d8d96d service nova] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ea23b626-1603-458e-b488-84a9e27efa8b req-ece1ad71-4adb-457c-a64a-f8f243d8d96d service nova] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-ea23b626-1603-458e-b488-84a9e27efa8b req-ece1ad71-4adb-457c-a64a-f8f243d8d96d service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] No waiting events found dispatching network-vif-unplugged-5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-ea23b626-1603-458e-b488-84a9e27efa8b req-ece1ad71-4adb-457c-a64a-f8f243d8d96d service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Received event network-vif-unplugged-5ce19f2d-3fba-45ff-beb2-91952d77e21a for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG os_brick.utils [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7254a1c2-cc19-4e18-b576-534dde915ac1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2fa5aa-e04a-4479-bc7b-aff834f37e67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf11cca-4bcf-4f1d-9ae2-90fdb20d40c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83e6b8b-4021-48f2-b384-758cbe2a8059]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:41 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d72742-7b64-4bf6-b315-6fc33f568445]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG os_brick.utils [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Updating existing volume attachment record: a139ba35-4ec8-4af1-9de2-d5b3ab45d41f {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:41 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Instance destroyed successfully.
Nov 16 05:34:41 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'resources' on Instance uuid 5687e588-1245-42a9-b2d8-306c3c6bf8c5 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1367235446',display_name='tempest-AttachVolumeNegativeTest-server-1367235446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1367235446',id=5,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqqaBveXhUlZCtxx2nqQZK/tN+anMq8dLx/U4hMGKNiLqpSCCi9jrye+6cS2kiF5cwxrWEN7NvUc+sJ1gtuB4CY3VcqcSmSIQmt5VtyobILVdYZV+98mHfAunYaa4AsRQ==',key_name='tempest-keypair-1305709446',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f585dcb9e6cb432a9b04526ebc30e9d8',ramdisk_id='',reservation_id='r-o9ur5wwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-155531213',owner_user_name='tempest-AttachVolumeNegativeTest-155531213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:29:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952a7ea7e63649259b0b1e0df40c97d0',uuid=5687e588-1245-42a9-b2d8-306c3c6bf8c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "address": "fa:16:3e:41:e0:38", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce19f2d-3f", "ovs_interfaceid": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converting VIF {"id": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "address": "fa:16:3e:41:e0:38", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce19f2d-3f", "ovs_interfaceid": "5ce19f2d-3fba-45ff-beb2-91952d77e21a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:e0:38,bridge_name='br-int',has_traffic_filtering=True,id=5ce19f2d-3fba-45ff-beb2-91952d77e21a,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce19f2d-3f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG os_vif [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:e0:38,bridge_name='br-int',has_traffic_filtering=True,id=5ce19f2d-3fba-45ff-beb2-91952d77e21a,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce19f2d-3f') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ce19f2d-3f, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a38620bb-39bb-48e6-b471-8c25d344f6cb) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:41 user nova-compute[80928]: INFO os_vif [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:e0:38,bridge_name='br-int',has_traffic_filtering=True,id=5ce19f2d-3fba-45ff-beb2-91952d77e21a,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce19f2d-3f')
Nov 16 05:34:41 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Deleting instance files /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5_del
Nov 16 05:34:41 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Deletion of /opt/stack/data/nova/instances/5687e588-1245-42a9-b2d8-306c3c6bf8c5_del complete
Nov 16 05:34:41 user nova-compute[80928]: INFO nova.compute.manager [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 16 05:34:41 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:34:41 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:34:42 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:42 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Took 0.75 seconds to deallocate network for instance.
Nov 16 05:34:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:42 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:34:42 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:34:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:42 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Deleted allocations for instance 5687e588-1245-42a9-b2d8-306c3c6bf8c5
Nov 16 05:34:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c543cbac-92a8-43a9-ab00-392b2746d177 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.315s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:43 user nova-compute[80928]: DEBUG nova.compute.manager [req-bec419cb-49ec-4fdd-8a97-1d1e23b403e1 req-93fdfa7c-1f26-47e3-96a9-9b9b1688663e service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Received event network-vif-plugged-5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bec419cb-49ec-4fdd-8a97-1d1e23b403e1 req-93fdfa7c-1f26-47e3-96a9-9b9b1688663e service nova] Acquiring lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bec419cb-49ec-4fdd-8a97-1d1e23b403e1 req-93fdfa7c-1f26-47e3-96a9-9b9b1688663e service nova] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bec419cb-49ec-4fdd-8a97-1d1e23b403e1 req-93fdfa7c-1f26-47e3-96a9-9b9b1688663e service nova] Lock "5687e588-1245-42a9-b2d8-306c3c6bf8c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:43 user nova-compute[80928]: DEBUG nova.compute.manager [req-bec419cb-49ec-4fdd-8a97-1d1e23b403e1 req-93fdfa7c-1f26-47e3-96a9-9b9b1688663e service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] No waiting events found dispatching network-vif-plugged-5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:43 user nova-compute[80928]: WARNING nova.compute.manager [req-bec419cb-49ec-4fdd-8a97-1d1e23b403e1 req-93fdfa7c-1f26-47e3-96a9-9b9b1688663e service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Received unexpected event network-vif-plugged-5ce19f2d-3fba-45ff-beb2-91952d77e21a for instance with vm_state deleted and task_state None.
Nov 16 05:34:43 user nova-compute[80928]: DEBUG nova.compute.manager [req-bec419cb-49ec-4fdd-8a97-1d1e23b403e1 req-93fdfa7c-1f26-47e3-96a9-9b9b1688663e service nova] [instance: 5687e588-1245-42a9-b2d8-306c3c6bf8c5] Received event network-vif-deleted-5ce19f2d-3fba-45ff-beb2-91952d77e21a {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:44 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d9495878-bdc8-4448-9a96-a93168cca9dd is timed out.
Nov 16 05:34:44 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Successfully detached device vdb from instance d9495878-bdc8-4448-9a96-a93168cca9dd from the live domain config.
Nov 16 05:34:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRZfMoHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:44 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcd8a3c-50fc-4237-89d7-2d6d579c0c58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:34:44 user nova-compute[80928]: No targets found.
Nov 16 05:34:44 user nova-compute[80928]: iSNS:
Nov 16 05:34:44 user nova-compute[80928]: No targets found.
Nov 16 05:34:44 user nova-compute[80928]: STATIC:
Nov 16 05:34:44 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca
Nov 16 05:34:44 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:44 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:44 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7
Nov 16 05:34:44 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:44 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:44 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:34:44 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:44 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:44 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0
Nov 16 05:34:44 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:44 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:44 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:34:44 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:44 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:44 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6
Nov 16 05:34:44 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:44 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:44 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0
Nov 16 05:34:44 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:44 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:44 user nova-compute[80928]: FIRMWARE:
Nov 16 05:34:44 user nova-compute[80928]: No targets found.
Nov 16 05:34:44 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:34:44 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:34:44 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f298ee-6fd1-4f46-88f8-1b0c988aaa87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4878c618-f8b0-4297-82c7-760548cf6848]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:44 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:44 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:44 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:44 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:44 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:44 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:44 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:44 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:44 user nova-compute[80928]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca (non-flash)
Nov 16 05:34:44 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:44 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:44 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:44 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:44 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585479a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca'): ({'sdd'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Removing single pathed devices sdd {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1edc22c-88ef-47dd-a200-4838650cc942]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f154ec-2bfc-4299-b207-36ddca9766cf]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Flushing IO for device /dev/sdd {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced70bc5-b2e7-4567-ac1a-d9384e609d7a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44f36a2-e699-46bd-9410-ec415f215f83]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbab0b2-2b64-4804-89d7-518a8ea08488]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c0b08f-7c37-4d33-9bef-ada09bf1fdad]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca, portal: 172.16.0.220,3260]
Nov 16 05:34:44 user nova-compute[80928]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca, portal: 172.16.0.220,3260] successful.
Nov 16 05:34:44 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557ce442-f7c1-4b2f-a4a4-7ab03dbb55ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[909c59df-b958-4b3d-b045-913a457c2806]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] <== disconnect_volume: return (342ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:34:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:45 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lazy-loading 'flavor' on Instance uuid d9495878-bdc8-4448-9a96-a93168cca9dd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e2d8c708-48b8-4741-86fc-10418ba1174c tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.870s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "interface-d9495878-bdc8-4448-9a96-a93168cca9dd-ab94c533-dec6-4247-98b3-06659931293c" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "interface-d9495878-bdc8-4448-9a96-a93168cca9dd-ab94c533-dec6-4247-98b3-06659931293c" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.objects.instance [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lazy-loading 'flavor' on Instance uuid d9495878-bdc8-4448-9a96-a93168cca9dd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448719116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448719116',id=16,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbrfYM9Tfxryjx25pcrdzFi6aMDXg1GtvKXo5V5iWQ1HHL8WU/nWyrqQDT+9C4YMMZjtHiahtk+lIZb+3YjTrRbWV9Wq2Su/5MArY3ntN9SR2zMGcvMMV9nYJ5E0xygtw==',key_name='tempest-keypair-1199152231',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:32:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d070f9d7fdfa47138f3f58b567211b71',ramdisk_id='',reservation_id='r-6v774qk5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-878046877',owner_user_name='tempest-TaggedAttachmentsTest-878046877-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee02ffd699942259a6f10355af24e94',uuid=d9495878-bdc8-4448-9a96-a93168cca9dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab94c533-dec6-4247-98b3-06659931293c", "address": "fa:16:3e:0a:57:8a", "network": {"id": "6a41470f-2152-4682-b333-e3702141f978", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1925366456", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab94c533-de", "ovs_interfaceid": "ab94c533-dec6-4247-98b3-06659931293c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converting VIF {"id": "ab94c533-dec6-4247-98b3-06659931293c", "address": "fa:16:3e:0a:57:8a", "network": {"id": "6a41470f-2152-4682-b333-e3702141f978", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1925366456", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab94c533-de", "ovs_interfaceid": "ab94c533-dec6-4247-98b3-06659931293c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:57:8a,bridge_name='br-int',has_traffic_filtering=True,id=ab94c533-dec6-4247-98b3-06659931293c,network=Network(6a41470f-2152-4682-b333-e3702141f978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab94c533-de') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0a:57:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tapab94c533-de"/></interface> {{(pid=80928) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0a:57:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tapab94c533-de"/></interface> {{(pid=80928) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Attempting to detach device tapab94c533-de from instance d9495878-bdc8-4448-9a96-a93168cca9dd from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] detach device xml: <interface type="ethernet">
Nov 16 05:34:46 user nova-compute[80928]:   <mac address="fa:16:3e:0a:57:8a"/>
Nov 16 05:34:46 user nova-compute[80928]:   <model type="virtio"/>
Nov 16 05:34:46 user nova-compute[80928]:   <mtu size="1442"/>
Nov 16 05:34:46 user nova-compute[80928]:   <target dev="tapab94c533-de"/>
Nov 16 05:34:46 user nova-compute[80928]: </interface>
Nov 16 05:34:46 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0a:57:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tapab94c533-de"/></interface> {{(pid=80928) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0a:57:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tapab94c533-de"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 16 05:34:46 user nova-compute[80928]:   <name>instance-00000010</name>
Nov 16 05:34:46 user nova-compute[80928]:   <uuid>d9495878-bdc8-4448-9a96-a93168cca9dd</uuid>
Nov 16 05:34:46 user nova-compute[80928]:   <metadata>
Nov 16 05:34:46 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:34:46 user nova-compute[80928]:   <nova:package version="0.0.0"/>
Nov 16 05:34:46 user nova-compute[80928]:   <nova:name>tempest-device-tagging-server-448719116</nova:name>
Nov 16 05:34:46 user nova-compute[80928]:   <nova:creationTime>2023-11-16 05:34:13</nova:creationTime>
Nov 16 05:34:46 user nova-compute[80928]:   <nova:flavor name="m1.tiny">
Nov 16 05:34:46 user nova-compute[80928]:     <nova:memory>512</nova:memory>
Nov 16 05:34:46 user nova-compute[80928]:     <nova:disk>1</nova:disk>
Nov 16 05:34:46 user nova-compute[80928]:     <nova:swap>0</nova:swap>
Nov 16 05:34:46 user nova-compute[80928]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:34:46 user nova-compute[80928]:     <nova:vcpus>1</nova:vcpus>
Nov 16 05:34:46 user nova-compute[80928]:   </nova:flavor>
Nov 16 05:34:46 user nova-compute[80928]:   <nova:owner>
Nov 16 05:34:46 user nova-compute[80928]:     <nova:user uuid="aee02ffd699942259a6f10355af24e94">tempest-TaggedAttachmentsTest-878046877-project-member</nova:user>
Nov 16 05:34:46 user nova-compute[80928]:     <nova:project uuid="d070f9d7fdfa47138f3f58b567211b71">tempest-TaggedAttachmentsTest-878046877</nova:project>
Nov 16 05:34:46 user nova-compute[80928]:   </nova:owner>
Nov 16 05:34:46 user nova-compute[80928]:   <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:34:46 user nova-compute[80928]:   <nova:ports>
Nov 16 05:34:46 user nova-compute[80928]:     <nova:port uuid="5d98342e-40a0-4426-977e-b9c61886687b">
Nov 16 05:34:46 user nova-compute[80928]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 05:34:46 user nova-compute[80928]:     </nova:port>
Nov 16 05:34:46 user nova-compute[80928]:     <nova:port uuid="ab94c533-dec6-4247-98b3-06659931293c">
Nov 16 05:34:46 user nova-compute[80928]:       <nova:ip type="fixed" address="10.10.10.157" ipVersion="4"/>
Nov 16 05:34:46 user nova-compute[80928]:     </nova:port>
Nov 16 05:34:46 user nova-compute[80928]:   </nova:ports>
Nov 16 05:34:46 user nova-compute[80928]: </nova:instance>
Nov 16 05:34:46 user nova-compute[80928]:   </metadata>
Nov 16 05:34:46 user nova-compute[80928]:   <memory unit='KiB'>524288</memory>
Nov 16 05:34:46 user nova-compute[80928]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 05:34:46 user nova-compute[80928]:   <vcpu placement='static'>1</vcpu>
Nov 16 05:34:46 user nova-compute[80928]:   <resource>
Nov 16 05:34:46 user nova-compute[80928]:     <partition>/machine</partition>
Nov 16 05:34:46 user nova-compute[80928]:   </resource>
Nov 16 05:34:46 user nova-compute[80928]:   <sysinfo type='smbios'>
Nov 16 05:34:46 user nova-compute[80928]:     <system>
Nov 16 05:34:46 user nova-compute[80928]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 05:34:46 user nova-compute[80928]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 05:34:46 user nova-compute[80928]:       <entry name='version'>0.0.0</entry>
Nov 16 05:34:46 user nova-compute[80928]:       <entry name='serial'>d9495878-bdc8-4448-9a96-a93168cca9dd</entry>
Nov 16 05:34:46 user nova-compute[80928]:       <entry name='uuid'>d9495878-bdc8-4448-9a96-a93168cca9dd</entry>
Nov 16 05:34:46 user nova-compute[80928]:       <entry name='family'>Virtual Machine</entry>
Nov 16 05:34:46 user nova-compute[80928]:     </system>
Nov 16 05:34:46 user nova-compute[80928]:   </sysinfo>
Nov 16 05:34:46 user nova-compute[80928]:   <os>
Nov 16 05:34:46 user nova-compute[80928]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 05:34:46 user nova-compute[80928]:     <boot dev='hd'/>
Nov 16 05:34:46 user nova-compute[80928]:     <smbios mode='sysinfo'/>
Nov 16 05:34:46 user nova-compute[80928]:   </os>
Nov 16 05:34:46 user nova-compute[80928]:   <features>
Nov 16 05:34:46 user nova-compute[80928]:     <acpi/>
Nov 16 05:34:46 user nova-compute[80928]:     <apic/>
Nov 16 05:34:46 user nova-compute[80928]:     <vmcoreinfo state='on'/>
Nov 16 05:34:46 user nova-compute[80928]:   </features>
Nov 16 05:34:46 user nova-compute[80928]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 05:34:46 user nova-compute[80928]:     <model fallback='forbid'>Nehalem</model>
Nov 16 05:34:46 user nova-compute[80928]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 05:34:46 user nova-compute[80928]:     <feature policy='require' name='vme'/>
Nov 16 05:34:46 user nova-compute[80928]:     <feature policy='require' name='x2apic'/>
Nov 16 05:34:46 user nova-compute[80928]:     <feature policy='require' name='hypervisor'/>
Nov 16 05:34:46 user nova-compute[80928]:   </cpu>
Nov 16 05:34:46 user nova-compute[80928]:   <clock offset='utc'>
Nov 16 05:34:46 user nova-compute[80928]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 05:34:46 user nova-compute[80928]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 05:34:46 user nova-compute[80928]:     <timer name='hpet' present='no'/>
Nov 16 05:34:46 user nova-compute[80928]:   </clock>
Nov 16 05:34:46 user nova-compute[80928]:   <on_poweroff>destroy</on_poweroff>
Nov 16 05:34:46 user nova-compute[80928]:   <on_reboot>restart</on_reboot>
Nov 16 05:34:46 user nova-compute[80928]:   <on_crash>destroy</on_crash>
Nov 16 05:34:46 user nova-compute[80928]:   <devices>
Nov 16 05:34:46 user nova-compute[80928]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 05:34:46 user nova-compute[80928]:     <disk type='file' device='disk'>
Nov 16 05:34:46 user nova-compute[80928]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 05:34:46 user nova-compute[80928]:       <source file='/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk' index='2'/>
Nov 16 05:34:46 user nova-compute[80928]:       <backingStore type='file' index='3'>
Nov 16 05:34:46 user nova-compute[80928]:         <format type='raw'/>
Nov 16 05:34:46 user nova-compute[80928]:         <source file='/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176'/>
Nov 16 05:34:46 user nova-compute[80928]:         <backingStore/>
Nov 16 05:34:46 user nova-compute[80928]:       </backingStore>
Nov 16 05:34:46 user nova-compute[80928]:       <target dev='vda' bus='virtio'/>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='virtio-disk0'/>
Nov 16 05:34:46 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 05:34:46 user nova-compute[80928]:     </disk>
Nov 16 05:34:46 user nova-compute[80928]:     <disk type='file' device='cdrom'>
Nov 16 05:34:46 user nova-compute[80928]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 05:34:46 user nova-compute[80928]:       <source file='/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk.config' index='1'/>
Nov 16 05:34:46 user nova-compute[80928]:       <backingStore/>
Nov 16 05:34:46 user nova-compute[80928]:       <target dev='hda' bus='ide'/>
Nov 16 05:34:46 user nova-compute[80928]:       <readonly/>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='ide0-0-0'/>
Nov 16 05:34:46 user nova-compute[80928]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 05:34:46 user nova-compute[80928]:     </disk>
Nov 16 05:34:46 user nova-compute[80928]:     <controller type='usb' index='0' model='none'>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='usb'/>
Nov 16 05:34:46 user nova-compute[80928]:     </controller>
Nov 16 05:34:46 user nova-compute[80928]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='pci.0'/>
Nov 16 05:34:46 user nova-compute[80928]:     </controller>
Nov 16 05:34:46 user nova-compute[80928]:     <controller type='ide' index='0'>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='ide'/>
Nov 16 05:34:46 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 05:34:46 user nova-compute[80928]:     </controller>
Nov 16 05:34:46 user nova-compute[80928]:     <interface type='ethernet'>
Nov 16 05:34:46 user nova-compute[80928]:       <mac address='fa:16:3e:9d:25:09'/>
Nov 16 05:34:46 user nova-compute[80928]:       <target dev='tap5d98342e-40'/>
Nov 16 05:34:46 user nova-compute[80928]:       <model type='virtio'/>
Nov 16 05:34:46 user nova-compute[80928]:       <mtu size='1442'/>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='net0'/>
Nov 16 05:34:46 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 05:34:46 user nova-compute[80928]:     </interface>
Nov 16 05:34:46 user nova-compute[80928]:     <interface type='ethernet'>
Nov 16 05:34:46 user nova-compute[80928]:       <mac address='fa:16:3e:0a:57:8a'/>
Nov 16 05:34:46 user nova-compute[80928]:       <target dev='tapab94c533-de'/>
Nov 16 05:34:46 user nova-compute[80928]:       <model type='virtio'/>
Nov 16 05:34:46 user nova-compute[80928]:       <mtu size='1442'/>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='net1'/>
Nov 16 05:34:46 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 16 05:34:46 user nova-compute[80928]:     </interface>
Nov 16 05:34:46 user nova-compute[80928]:     <serial type='pty'>
Nov 16 05:34:46 user nova-compute[80928]:       <source path='/dev/pts/10'/>
Nov 16 05:34:46 user nova-compute[80928]:       <log file='/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/console.log' append='off'/>
Nov 16 05:34:46 user nova-compute[80928]:       <target type='isa-serial' port='0'>
Nov 16 05:34:46 user nova-compute[80928]:         <model name='isa-serial'/>
Nov 16 05:34:46 user nova-compute[80928]:       </target>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='serial0'/>
Nov 16 05:34:46 user nova-compute[80928]:     </serial>
Nov 16 05:34:46 user nova-compute[80928]:     <console type='pty' tty='/dev/pts/10'>
Nov 16 05:34:46 user nova-compute[80928]:       <source path='/dev/pts/10'/>
Nov 16 05:34:46 user nova-compute[80928]:       <log file='/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/console.log' append='off'/>
Nov 16 05:34:46 user nova-compute[80928]:       <target type='serial' port='0'/>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='serial0'/>
Nov 16 05:34:46 user nova-compute[80928]:     </console>
Nov 16 05:34:46 user nova-compute[80928]:     <input type='mouse' bus='ps2'>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='input0'/>
Nov 16 05:34:46 user nova-compute[80928]:     </input>
Nov 16 05:34:46 user nova-compute[80928]:     <input type='keyboard' bus='ps2'>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='input1'/>
Nov 16 05:34:46 user nova-compute[80928]:     </input>
Nov 16 05:34:46 user nova-compute[80928]:     <graphics type='vnc' port='5912' autoport='yes' listen='0.0.0.0'>
Nov 16 05:34:46 user nova-compute[80928]:       <listen type='address' address='0.0.0.0'/>
Nov 16 05:34:46 user nova-compute[80928]:     </graphics>
Nov 16 05:34:46 user nova-compute[80928]:     <audio id='1' type='none'/>
Nov 16 05:34:46 user nova-compute[80928]:     <video>
Nov 16 05:34:46 user nova-compute[80928]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='video0'/>
Nov 16 05:34:46 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 05:34:46 user nova-compute[80928]:     </video>
Nov 16 05:34:46 user nova-compute[80928]:     <memballoon model='virtio'>
Nov 16 05:34:46 user nova-compute[80928]:       <stats period='10'/>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='balloon0'/>
Nov 16 05:34:46 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 05:34:46 user nova-compute[80928]:     </memballoon>
Nov 16 05:34:46 user nova-compute[80928]:     <rng model='virtio'>
Nov 16 05:34:46 user nova-compute[80928]:       <backend model='random'>/dev/urandom</backend>
Nov 16 05:34:46 user nova-compute[80928]:       <alias name='rng0'/>
Nov 16 05:34:46 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 05:34:46 user nova-compute[80928]:     </rng>
Nov 16 05:34:46 user nova-compute[80928]:   </devices>
Nov 16 05:34:46 user nova-compute[80928]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 05:34:46 user nova-compute[80928]:     <label>libvirt-d9495878-bdc8-4448-9a96-a93168cca9dd</label>
Nov 16 05:34:46 user nova-compute[80928]:     <imagelabel>libvirt-d9495878-bdc8-4448-9a96-a93168cca9dd</imagelabel>
Nov 16 05:34:46 user nova-compute[80928]:   </seclabel>
Nov 16 05:34:46 user nova-compute[80928]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 05:34:46 user nova-compute[80928]:     <label>+64055:+108</label>
Nov 16 05:34:46 user nova-compute[80928]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 05:34:46 user nova-compute[80928]:   </seclabel>
Nov 16 05:34:46 user nova-compute[80928]: </domain>
Nov 16 05:34:46 user nova-compute[80928]:  {{(pid=80928) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 05:34:46 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Successfully detached device tapab94c533-de from instance d9495878-bdc8-4448-9a96-a93168cca9dd from the persistent domain config.
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] (1/8): Attempting to detach device tapab94c533-de with device alias net1 from instance d9495878-bdc8-4448-9a96-a93168cca9dd from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] detach device xml: <interface type="ethernet">
Nov 16 05:34:46 user nova-compute[80928]:   <mac address="fa:16:3e:0a:57:8a"/>
Nov 16 05:34:46 user nova-compute[80928]:   <model type="virtio"/>
Nov 16 05:34:46 user nova-compute[80928]:   <mtu size="1442"/>
Nov 16 05:34:46 user nova-compute[80928]:   <target dev="tapab94c533-de"/>
Nov 16 05:34:46 user nova-compute[80928]: </interface>
Nov 16 05:34:46 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSJdlrqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:46 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:46 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:46 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2efc753-3d74-4b25-9912-72ff17dcc5e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:34:46 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bbe626-c666-46de-8466-d938ddbc2411]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Start waiting for the detach event from libvirt for device tapab94c533-de with device alias net1 for instance d9495878-bdc8-4448-9a96-a93168cca9dd {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0] added
Nov 16 05:34:46 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e95c591-c95d-467e-891f-0f28be095b4a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f99ab2-3257-45a5-8b02-342f84d01a58]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FSJdlrqL {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FSJdlrqL" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d295df-e64e-40ed-92b0-6402a57e823b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FSJdlrqL'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[16267628-3ed4-4256-8a48-2856ea1c09b0]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e14dc90-0991-4051-b192-11c929033f54]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-b4d1a1e0-0a42-4df3-adf1-d05d85526bdc req-dbc5855a-b704-469b-87e4-17bebfc12572 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-vif-unplugged-ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b4d1a1e0-0a42-4df3-adf1-d05d85526bdc req-dbc5855a-b704-469b-87e4-17bebfc12572 service nova] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b4d1a1e0-0a42-4df3-adf1-d05d85526bdc req-dbc5855a-b704-469b-87e4-17bebfc12572 service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b4d1a1e0-0a42-4df3-adf1-d05d85526bdc req-dbc5855a-b704-469b-87e4-17bebfc12572 service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-b4d1a1e0-0a42-4df3-adf1-d05d85526bdc req-dbc5855a-b704-469b-87e4-17bebfc12572 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] No waiting events found dispatching network-vif-unplugged-ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:46 user nova-compute[80928]: WARNING nova.compute.manager [req-b4d1a1e0-0a42-4df3-adf1-d05d85526bdc req-dbc5855a-b704-469b-87e4-17bebfc12572 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received unexpected event network-vif-unplugged-ab94c533-dec6-4247-98b3-06659931293c for instance with vm_state active and task_state None.
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2c93e7-94de-495b-97b9-f698198f9e2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260]
Nov 16 05:34:46 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260] successful.
Nov 16 05:34:46 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5024ea6-a61d-4db9-8b8b-19c6bbcdf536]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6768a7-8a3f-47b2-b83e-feb9f4529e7b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:34:46 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[099332ae-51dd-42ee-a211-1391dc7d5154]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSJdlrqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-91e0c678-899c-4676-b76b-6a0f39621052 req-41d4aee6-71c9-4be4-9bb5-a5045429e842 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-changed-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-91e0c678-899c-4676-b76b-6a0f39621052 req-41d4aee6-71c9-4be4-9bb5-a5045429e842 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Refreshing instance network info cache due to event network-changed-3fd63666-004c-416e-877a-dbc4fcbe6fcd. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-91e0c678-899c-4676-b76b-6a0f39621052 req-41d4aee6-71c9-4be4-9bb5-a5045429e842 service nova] Acquiring lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-91e0c678-899c-4676-b76b-6a0f39621052 req-41d4aee6-71c9-4be4-9bb5-a5045429e842 service nova] Acquired lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG nova.network.neutron [req-91e0c678-899c-4676-b76b-6a0f39621052 req-41d4aee6-71c9-4be4-9bb5-a5045429e842 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Refreshing network info cache for port 3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG nova.network.neutron [req-91e0c678-899c-4676-b76b-6a0f39621052 req-41d4aee6-71c9-4be4-9bb5-a5045429e842 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updated VIF entry in instance network info cache for port 3fd63666-004c-416e-877a-dbc4fcbe6fcd. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG nova.network.neutron [req-91e0c678-899c-4676-b76b-6a0f39621052 req-41d4aee6-71c9-4be4-9bb5-a5045429e842 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updating instance_info_cache with network_info: [{"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-91e0c678-899c-4676-b76b-6a0f39621052 req-41d4aee6-71c9-4be4-9bb5-a5045429e842 service nova] Releasing lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23861363230616539', 'path': '/dev/sdd'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861363230616539', 'path': '/dev/sdd'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lazy-loading 'flavor' on Instance uuid 859f06da-737e-40c3-9e85-2fd33052a9ea {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:34:48 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:34:48 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:34:48 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:34:48 user nova-compute[80928]:   <serial>5ca704f9-941d-4088-80bc-d998989f18c0</serial>
Nov 16 05:34:48 user nova-compute[80928]: </disk>
Nov 16 05:34:48 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No VIF found with MAC fa:16:3e:b3:20:4d, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f821f0da-fdc7-4285-98f8-961df4b9b64b tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.551s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-e8e34912-81a0-4b1d-9651-b685f74385ac req-cadd9f59-c5c9-486a-abd7-7c2e61301c59 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-vif-plugged-ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e8e34912-81a0-4b1d-9651-b685f74385ac req-cadd9f59-c5c9-486a-abd7-7c2e61301c59 service nova] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e8e34912-81a0-4b1d-9651-b685f74385ac req-cadd9f59-c5c9-486a-abd7-7c2e61301c59 service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e8e34912-81a0-4b1d-9651-b685f74385ac req-cadd9f59-c5c9-486a-abd7-7c2e61301c59 service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-e8e34912-81a0-4b1d-9651-b685f74385ac req-cadd9f59-c5c9-486a-abd7-7c2e61301c59 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] No waiting events found dispatching network-vif-plugged-ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:48 user nova-compute[80928]: WARNING nova.compute.manager [req-e8e34912-81a0-4b1d-9651-b685f74385ac req-cadd9f59-c5c9-486a-abd7-7c2e61301c59 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received unexpected event network-vif-plugged-ab94c533-dec6-4247-98b3-06659931293c for instance with vm_state active and task_state None.
Nov 16 05:34:49 user nova-compute[80928]: INFO nova.compute.manager [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Rebuilding instance
Nov 16 05:34:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:34:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-e0215aa4-5482-498b-9720-012a30a2fbc3 req-88b00cf3-6e7e-4120-8c78-6b261c3813c6 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received event network-vif-unplugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e0215aa4-5482-498b-9720-012a30a2fbc3 req-88b00cf3-6e7e-4120-8c78-6b261c3813c6 service nova] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e0215aa4-5482-498b-9720-012a30a2fbc3 req-88b00cf3-6e7e-4120-8c78-6b261c3813c6 service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e0215aa4-5482-498b-9720-012a30a2fbc3 req-88b00cf3-6e7e-4120-8c78-6b261c3813c6 service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-e0215aa4-5482-498b-9720-012a30a2fbc3 req-88b00cf3-6e7e-4120-8c78-6b261c3813c6 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] No waiting events found dispatching network-vif-unplugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:50 user nova-compute[80928]: WARNING nova.compute.manager [req-e0215aa4-5482-498b-9720-012a30a2fbc3 req-88b00cf3-6e7e-4120-8c78-6b261c3813c6 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received unexpected event network-vif-unplugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 for instance with vm_state active and task_state rebuilding.
Nov 16 05:34:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "1d95a79b-847f-4eba-a096-65c834f94a40" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:50 user nova-compute[80928]: INFO nova.compute.manager [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Shelving
Nov 16 05:34:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Instance destroyed successfully.
Nov 16 05:34:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Instance destroyed successfully.
Nov 16 05:34:51 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Beginning cold snapshot process
Nov 16 05:34:51 user nova-compute[80928]: INFO nova.compute.manager [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Detaching volume 5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:34:51 user nova-compute[80928]: INFO nova.virt.block_device [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Attempting to driver detach volume 5ca704f9-941d-4088-80bc-d998989f18c0 from mountpoint /dev/vdb
Nov 16 05:34:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Attempting to detach device vdb from instance 859f06da-737e-40c3-9e85-2fd33052a9ea from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:34:51 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:34:51 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:34:51 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:34:51 user nova-compute[80928]:   <serial>5ca704f9-941d-4088-80bc-d998989f18c0</serial>
Nov 16 05:34:51 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:34:51 user nova-compute[80928]: </disk>
Nov 16 05:34:51 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:34:51 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully detached device vdb from instance 859f06da-737e-40c3-9e85-2fd33052a9ea from the persistent domain config.
Nov 16 05:34:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSJdlrqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:51 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk /opt/stack/data/nova/instances/snapshots/tmp9hdpbjnn/a939f92b5b25453ca4b06a616210bffc {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8922707c-88ed-4435-ab63-48c95b715178]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:34:51 user nova-compute[80928]: No targets found.
Nov 16 05:34:51 user nova-compute[80928]: iSNS:
Nov 16 05:34:51 user nova-compute[80928]: No targets found.
Nov 16 05:34:51 user nova-compute[80928]: STATIC:
Nov 16 05:34:51 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:34:51 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:51 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:51 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7
Nov 16 05:34:51 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:51 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:51 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:34:51 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:51 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:51 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0
Nov 16 05:34:51 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:51 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:51 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:34:51 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:51 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:51 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6
Nov 16 05:34:51 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:51 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:51 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0
Nov 16 05:34:51 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:51 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:51 user nova-compute[80928]: FIRMWARE:
Nov 16 05:34:51 user nova-compute[80928]: No targets found.
Nov 16 05:34:51 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:34:51 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:34:51 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d971ab7-a49d-44f4-880e-ab71b1374e12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c8742c-77d6-423c-8fd2-097b11cac1bb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:34:51 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8658547880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0'): ({'sdd'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Removing single pathed devices sdd {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9023324-178d-4114-9da3-5d0325ff85f6]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec88984-2fdb-4bc1-b7bc-a5428a72713c]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flushing IO for device /dev/sdd {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[be538861-ecc0-4ff7-98e8-87fe9c860cc4]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[02db86a9-7481-4301-b77d-17394d4e466e]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a06048-a563-43fe-ac11-4f24275318e8]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[65160f43-e8ad-4b62-9763-4102295d483a]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260]
Nov 16 05:34:51 user nova-compute[80928]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260] successful.
Nov 16 05:34:51 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5854cf9-50e9-454f-936a-8812094b4a49]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== disconnect_volume: return (378ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances with incomplete migration  {{(pid=80928) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 05:34:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk /opt/stack/data/nova/instances/snapshots/tmp9hdpbjnn/a939f92b5b25453ca4b06a616210bffc" returned: 0 in 0.748s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:51 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Snapshot extracted, beginning image upload
Nov 16 05:34:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received event network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] No waiting events found dispatching network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:52 user nova-compute[80928]: WARNING nova.compute.manager [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received unexpected event network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 for instance with vm_state active and task_state rebuilding.
Nov 16 05:34:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-vif-unplugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] No waiting events found dispatching network-vif-unplugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:52 user nova-compute[80928]: WARNING nova.compute.manager [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received unexpected event network-vif-unplugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 05:34:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] No waiting events found dispatching network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:34:52 user nova-compute[80928]: WARNING nova.compute.manager [req-bfc6838b-be1a-4ce7-8c90-f9b77d26994a req-63b59c89-5da5-47ec-9366-7a00eff08f88 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received unexpected event network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 05:34:52 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Instance destroyed successfully.
Nov 16 05:34:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:32:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-33151290',display_name='tempest-ServerActionsTestOtherA-server-12103829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-33151290',id=17,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTVVxLriAse+8lverhdQdhnvii6w45qThd0fHyb5Ol521IcYdHykJ/QxuqMWVLnXJFzh4a6SQNJa6fCD+2a2PXyDp0J+MN8Qy1Dn2CkfQ45KGGkbsS5jLLHLRnfASO6mw==',key_name='tempest-keypair-661491812',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:32:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-p74fir7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=859f06da-737e-40c3-9e85-2fd33052a9ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_vif [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap810ff4e6-46, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f20e36af-5fc3-487e-960e-f36553f12080) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:52 user nova-compute[80928]: INFO os_vif [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46')
Nov 16 05:34:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSJdlrqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:52 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd46142-0562-46a6-8318-f9ac1e5f182b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:34:52 user nova-compute[80928]: No targets found.
Nov 16 05:34:52 user nova-compute[80928]: iSNS:
Nov 16 05:34:52 user nova-compute[80928]: No targets found.
Nov 16 05:34:52 user nova-compute[80928]: STATIC:
Nov 16 05:34:52 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7
Nov 16 05:34:52 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:52 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:52 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:34:52 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:52 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:52 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0
Nov 16 05:34:52 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:52 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:52 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:34:52 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:52 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:52 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6
Nov 16 05:34:52 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:52 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:52 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0
Nov 16 05:34:52 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:34:52 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:34:52 user nova-compute[80928]: FIRMWARE:
Nov 16 05:34:52 user nova-compute[80928]: No targets found.
Nov 16 05:34:52 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:34:52 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:34:52 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb6972a-117f-4e19-8e1e-3993676dc8cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[316e44fb-be13-4273-87de-64f91b410167]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:52 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:52 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:52 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:52 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:52 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:52 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:52 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:52 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:52 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:52 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:52 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:52 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a7250>, {}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Disconnecting from: [] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== disconnect_volume: return (86ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:34:52 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Deleting instance files /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea_del
Nov 16 05:34:52 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Deletion of /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea_del complete
Nov 16 05:34:52 user nova-compute[80928]: INFO nova.virt.block_device [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Booting with volume 5ca704f9-941d-4088-80bc-d998989f18c0 at /dev/vdb
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.utils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ec888e-1496-49d4-aa6f-e487103be214]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[165d836e-6b8e-4dcc-99b1-ab75bf851b78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[000892a8-a737-4f43-8292-634d235b1fea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3275bb5-4741-4306-a034-1a45300b958f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:34:52 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:34:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ade1ad-962a-490b-b919-cf922e6406c0]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG os_brick.utils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:34:52 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Updating existing volume attachment record: c2538fdf-6f57-4ba7-99f0-24ea574117f1 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:34:53 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:34:54 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Snapshot image upload complete
Nov 16 05:34:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:34:54 user nova-compute[80928]: INFO nova.compute.manager [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Shelve offloading
Nov 16 05:34:54 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Instance destroyed successfully.
Nov 16 05:34:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:34:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquired lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:54 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:34:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updating instance_info_cache with network_info: [{"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Releasing lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:55 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Instance destroyed successfully.
Nov 16 05:34:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'resources' on Instance uuid 1d95a79b-847f-4eba-a096-65c834f94a40 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-829617757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-829617757',id=18,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBVIcuLIoeyJUCfApF95eDV2Wo0tU7REYxuVWr/fb1xvg+3fDUjymswWM+MIn+/kdz99QUdgvxCYkYWnfYA61PMztbyoXcQ7rWJGut8ydbk3LZT4zuI8EfyKedqfH+Inw==',key_name='tempest-keypair-1667699851',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:33:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9efdd13a65f44182a910ecf45bf27116',ramdisk_id='',reservation_id='r-y0372kuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-658694431',owner_user_name='tempest-AttachVolumeShelveTestJSON-658694431-project-member',shelved_at='2023-11-16T05:34:54.685398',shelved_host='user',shelved_image_id='428ac015-a9d2-45a0-b464-01202500d216'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:34:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='505358920a9e43c59cf29b85ffbccb95',uuid=1d95a79b-847f-4eba-a096-65c834f94a40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converting VIF {"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG os_vif [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fd63666-00, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-cdddd4e6-7d09-435f-af76-7d751aa00e65 req-45d9a09c-672f-4003-b3a6-f1ed88639a6e service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-changed-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-cdddd4e6-7d09-435f-af76-7d751aa00e65 req-45d9a09c-672f-4003-b3a6-f1ed88639a6e service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Refreshing instance network info cache due to event network-changed-3fd63666-004c-416e-877a-dbc4fcbe6fcd. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cdddd4e6-7d09-435f-af76-7d751aa00e65 req-45d9a09c-672f-4003-b3a6-f1ed88639a6e service nova] Acquiring lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cdddd4e6-7d09-435f-af76-7d751aa00e65 req-45d9a09c-672f-4003-b3a6-f1ed88639a6e service nova] Acquired lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG nova.network.neutron [req-cdddd4e6-7d09-435f-af76-7d751aa00e65 req-45d9a09c-672f-4003-b3a6-f1ed88639a6e service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Refreshing network info cache for port 3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77f6082b-2e70-421d-938d-8b7a46dda2a9) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:34:55 user nova-compute[80928]: INFO os_vif [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00')
Nov 16 05:34:55 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Deleting instance files /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40_del
Nov 16 05:34:55 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Deletion of /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40_del complete
Nov 16 05:34:55 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Deleted allocations for instance 1d95a79b-847f-4eba-a096-65c834f94a40
Nov 16 05:34:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'numa_topology' on Instance uuid 1d95a79b-847f-4eba-a096-65c834f94a40 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:55 user nova-compute[80928]: DEBUG nova.objects.base [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Object Instance<1d95a79b-847f-4eba-a096-65c834f94a40> lazy-loaded attributes: resources,numa_topology {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG nova.network.neutron [req-cdddd4e6-7d09-435f-af76-7d751aa00e65 req-45d9a09c-672f-4003-b3a6-f1ed88639a6e service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updated VIF entry in instance network info cache for port 3fd63666-004c-416e-877a-dbc4fcbe6fcd. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG nova.network.neutron [req-cdddd4e6-7d09-435f-af76-7d751aa00e65 req-45d9a09c-672f-4003-b3a6-f1ed88639a6e service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updating instance_info_cache with network_info: [{"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3fd63666-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cdddd4e6-7d09-435f-af76-7d751aa00e65 req-45d9a09c-672f-4003-b3a6-f1ed88639a6e service nova] Releasing lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2bb374a-37ca-4bd8-a64b-67d0c7e3a8b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "1d95a79b-847f-4eba-a096-65c834f94a40" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.146s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:56 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:34:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:34:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:34:58 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Creating image(s)
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "/opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "/opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "/opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.044s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.166s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk 1073741824" returned: 0 in 0.047s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.161s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:34:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Cannot resize image /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Ensure instance console log exists: /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Start _get_guest_xml network_info=[{"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSJdlrqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '859f06da-737e-40c3-9e85-2fd33052a9ea', 'attached_at': '', 'detached_at': '', 'volume_id': '5ca704f9-941d-4088-80bc-d998989f18c0', 'serial': '5ca704f9-941d-4088-80bc-d998989f18c0'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c2538fdf-6f57-4ba7-99f0-24ea574117f1', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:34:59 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 05:34:59 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lazy-loading 'vcpu_model' on Instance uuid 859f06da-737e-40c3-9e85-2fd33052a9ea {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSJdlrqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:34:59 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:59 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:34:59 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef8cb54-d69e-45ba-ac57-872f1a78a439]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:34:59 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d614e29-81d1-4b13-9f7e-6c8fcf6fb50d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0] added
Nov 16 05:34:59 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad564bd-65b3-40ae-8cc6-873a18ad51ea]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2da6d6-0466-4a23-92ff-11140da5c989]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FSJdlrqL {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FSJdlrqL" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[517561fb-d012-4adf-8dee-3770b52a80ea]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FSJdlrqL'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b127291b-34b1-41b1-8782-c2b09fd1d5a3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e8d87d-e119-43c7-8761-c6bd1bae8391]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:59 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:59 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:59 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:59 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:59 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:59 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:34:59 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:34:59 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:34:59 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:34:59 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:34:59 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:34:59 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:34:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda2433d-2824-4439-a95e-0ec6b67dbd08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260]
Nov 16 05:35:00 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260] successful.
Nov 16 05:35:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:00 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:35:00 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7238MB free_disk=25.529537200927734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a343b1-0572-465c-8d08-0d3c0dfeca93]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b93df1f-3a6d-484e-86c0-77c126628a78]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:35:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.684s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a765ec06-4542-416f-9040-9aeec1799c8b]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSJdlrqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5d03bda0-20b8-497a-a87b-faee21624468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance d9495878-bdc8-4448-9a96-a93168cca9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 859f06da-737e-40c3-9e85-2fd33052a9ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance b0211dc5-730f-435b-8d39-3a1606a7696f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance c7409e6d-ea55-41eb-8fab-9fd6a42d21cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing inventories for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating ProviderTree inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing aggregate associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, aggregates: None {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing trait associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.731s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== connect_volume: return (1733ms) {'type': 'block', 'scsi_wwn': '23861363230616539', 'path': '/dev/sdd'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861363230616539', 'path': '/dev/sdd'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:32:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-33151290',display_name='tempest-ServerActionsTestOtherA-server-12103829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-33151290',id=17,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTVVxLriAse+8lverhdQdhnvii6w45qThd0fHyb5Ol521IcYdHykJ/QxuqMWVLnXJFzh4a6SQNJa6fCD+2a2PXyDp0J+MN8Qy1Dn2CkfQ45KGGkbsS5jLLHLRnfASO6mw==',key_name='tempest-keypair-661491812',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:32:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-p74fir7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=859f06da-737e-40c3-9e85-2fd33052a9ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:35:01 user nova-compute[80928]:   <uuid>859f06da-737e-40c3-9e85-2fd33052a9ea</uuid>
Nov 16 05:35:01 user nova-compute[80928]:   <name>instance-00000011</name>
Nov 16 05:35:01 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:35:01 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:35:01 user nova-compute[80928]:   <metadata>
Nov 16 05:35:01 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:35:01 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:35:01 user nova-compute[80928]:       <nova:name>tempest-ServerActionsTestOtherA-server-12103829</nova:name>
Nov 16 05:35:01 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:34:59</nova:creationTime>
Nov 16 05:35:01 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:35:01 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:35:01 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:35:01 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:35:01 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:35:01 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:35:01 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:35:01 user nova-compute[80928]:       <nova:owner>
Nov 16 05:35:01 user nova-compute[80928]:         <nova:user uuid="6b1697de2fd04b27bc89ec6430a8a51d">tempest-ServerActionsTestOtherA-1550926993-project-member</nova:user>
Nov 16 05:35:01 user nova-compute[80928]:         <nova:project uuid="9684eff8dae04ceeb858555284d27e39">tempest-ServerActionsTestOtherA-1550926993</nova:project>
Nov 16 05:35:01 user nova-compute[80928]:       </nova:owner>
Nov 16 05:35:01 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:35:01 user nova-compute[80928]:       <nova:ports>
Nov 16 05:35:01 user nova-compute[80928]:         <nova:port uuid="810ff4e6-46ca-448f-ba1c-047dc5db6d75">
Nov 16 05:35:01 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 05:35:01 user nova-compute[80928]:         </nova:port>
Nov 16 05:35:01 user nova-compute[80928]:       </nova:ports>
Nov 16 05:35:01 user nova-compute[80928]:     </nova:instance>
Nov 16 05:35:01 user nova-compute[80928]:   </metadata>
Nov 16 05:35:01 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:35:01 user nova-compute[80928]:     <system>
Nov 16 05:35:01 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:35:01 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:35:01 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:35:01 user nova-compute[80928]:       <entry name="serial">859f06da-737e-40c3-9e85-2fd33052a9ea</entry>
Nov 16 05:35:01 user nova-compute[80928]:       <entry name="uuid">859f06da-737e-40c3-9e85-2fd33052a9ea</entry>
Nov 16 05:35:01 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:35:01 user nova-compute[80928]:     </system>
Nov 16 05:35:01 user nova-compute[80928]:   </sysinfo>
Nov 16 05:35:01 user nova-compute[80928]:   <os>
Nov 16 05:35:01 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:35:01 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:35:01 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:35:01 user nova-compute[80928]:   </os>
Nov 16 05:35:01 user nova-compute[80928]:   <features>
Nov 16 05:35:01 user nova-compute[80928]:     <acpi/>
Nov 16 05:35:01 user nova-compute[80928]:     <apic/>
Nov 16 05:35:01 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:35:01 user nova-compute[80928]:   </features>
Nov 16 05:35:01 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:35:01 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:35:01 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:35:01 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:35:01 user nova-compute[80928]:   </clock>
Nov 16 05:35:01 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:35:01 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:35:01 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:35:01 user nova-compute[80928]:   </cpu>
Nov 16 05:35:01 user nova-compute[80928]:   <devices>
Nov 16 05:35:01 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:35:01 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:35:01 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk"/>
Nov 16 05:35:01 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:35:01 user nova-compute[80928]:     </disk>
Nov 16 05:35:01 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:35:01 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:35:01 user nova-compute[80928]:       <source dev="/dev/sdd"/>
Nov 16 05:35:01 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:35:01 user nova-compute[80928]:       <serial>5ca704f9-941d-4088-80bc-d998989f18c0</serial>
Nov 16 05:35:01 user nova-compute[80928]:     </disk>
Nov 16 05:35:01 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:35:01 user nova-compute[80928]:       <mac address="fa:16:3e:b3:20:4d"/>
Nov 16 05:35:01 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:35:01 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:35:01 user nova-compute[80928]:       <target dev="tap810ff4e6-46"/>
Nov 16 05:35:01 user nova-compute[80928]:     </interface>
Nov 16 05:35:01 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:35:01 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/console.log" append="off"/>
Nov 16 05:35:01 user nova-compute[80928]:     </serial>
Nov 16 05:35:01 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:35:01 user nova-compute[80928]:     <video>
Nov 16 05:35:01 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:35:01 user nova-compute[80928]:     </video>
Nov 16 05:35:01 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:35:01 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:35:01 user nova-compute[80928]:     </rng>
Nov 16 05:35:01 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:35:01 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:35:01 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:35:01 user nova-compute[80928]:     </memballoon>
Nov 16 05:35:01 user nova-compute[80928]:   </devices>
Nov 16 05:35:01 user nova-compute[80928]: </domain>
Nov 16 05:35:01 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:32:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-33151290',display_name='tempest-ServerActionsTestOtherA-server-12103829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-33151290',id=17,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTVVxLriAse+8lverhdQdhnvii6w45qThd0fHyb5Ol521IcYdHykJ/QxuqMWVLnXJFzh4a6SQNJa6fCD+2a2PXyDp0J+MN8Qy1Dn2CkfQ45KGGkbsS5jLLHLRnfASO6mw==',key_name='tempest-keypair-661491812',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:32:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-p74fir7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:34:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=859f06da-737e-40c3-9e85-2fd33052a9ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG os_vif [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c6e7848-3984-5f09-bbf0-b7c995a5ec15', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap810ff4e6-46, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap810ff4e6-46, col_values=(('qos', UUID('c4fff56d-6692-4578-ab29-6d6bd4e92f50')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap810ff4e6-46, col_values=(('external_ids', {'iface-id': '810ff4e6-46ca-448f-ba1c-047dc5db6d75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:20:4d', 'vm-uuid': '859f06da-737e-40c3-9e85-2fd33052a9ea'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:01 user nova-compute[80928]: INFO os_vif [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46')
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No VIF found with MAC fa:16:3e:b3:20:4d, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 05:35:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] There are 0 instances to clean {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 05:35:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:35:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-7370c7dd-95df-43e8-9a5d-a13d9740ab0f req-01e7f826-b2cc-4244-9f2e-5ec7c43b2ae1 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received event network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7370c7dd-95df-43e8-9a5d-a13d9740ab0f req-01e7f826-b2cc-4244-9f2e-5ec7c43b2ae1 service nova] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7370c7dd-95df-43e8-9a5d-a13d9740ab0f req-01e7f826-b2cc-4244-9f2e-5ec7c43b2ae1 service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7370c7dd-95df-43e8-9a5d-a13d9740ab0f req-01e7f826-b2cc-4244-9f2e-5ec7c43b2ae1 service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-7370c7dd-95df-43e8-9a5d-a13d9740ab0f req-01e7f826-b2cc-4244-9f2e-5ec7c43b2ae1 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] No waiting events found dispatching network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:02 user nova-compute[80928]: WARNING nova.compute.manager [req-7370c7dd-95df-43e8-9a5d-a13d9740ab0f req-01e7f826-b2cc-4244-9f2e-5ec7c43b2ae1 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received unexpected event network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 05:35:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-041a1a33-e663-4b69-a268-149a134210c0 req-3f560a3f-caaf-40ab-86f7-07ee774d6e89 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received event network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-041a1a33-e663-4b69-a268-149a134210c0 req-3f560a3f-caaf-40ab-86f7-07ee774d6e89 service nova] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-041a1a33-e663-4b69-a268-149a134210c0 req-3f560a3f-caaf-40ab-86f7-07ee774d6e89 service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-041a1a33-e663-4b69-a268-149a134210c0 req-3f560a3f-caaf-40ab-86f7-07ee774d6e89 service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-041a1a33-e663-4b69-a268-149a134210c0 req-3f560a3f-caaf-40ab-86f7-07ee774d6e89 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] No waiting events found dispatching network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:04 user nova-compute[80928]: WARNING nova.compute.manager [req-041a1a33-e663-4b69-a268-149a134210c0 req-3f560a3f-caaf-40ab-86f7-07ee774d6e89 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received unexpected event network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 05:35:04 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:35:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:35:04 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Instance spawned successfully.
Nov 16 05:35:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Trying to apply a migration context that does not seem to be set for this instance {{(pid=80928) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2ed31997-826f-432c-9bb4-2452a5e17482 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.078s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:05 user nova-compute[80928]: INFO nova.compute.manager [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Terminating instance
Nov 16 05:35:05 user nova-compute[80928]: DEBUG nova.compute.manager [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-af02e717-67ef-4110-9c50-d11e3d242737 req-c4eaa490-4a49-451c-91e6-5f0f54ac931b service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Received event network-vif-unplugged-f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-af02e717-67ef-4110-9c50-d11e3d242737 req-c4eaa490-4a49-451c-91e6-5f0f54ac931b service nova] Acquiring lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-af02e717-67ef-4110-9c50-d11e3d242737 req-c4eaa490-4a49-451c-91e6-5f0f54ac931b service nova] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-af02e717-67ef-4110-9c50-d11e3d242737 req-c4eaa490-4a49-451c-91e6-5f0f54ac931b service nova] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-af02e717-67ef-4110-9c50-d11e3d242737 req-c4eaa490-4a49-451c-91e6-5f0f54ac931b service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] No waiting events found dispatching network-vif-unplugged-f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-af02e717-67ef-4110-9c50-d11e3d242737 req-c4eaa490-4a49-451c-91e6-5f0f54ac931b service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Received event network-vif-unplugged-f4e24095-a59c-4e7a-8339-8afb6230dde5 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Instance destroyed successfully.
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.objects.instance [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lazy-loading 'resources' on Instance uuid ff21d416-8ff1-49b5-9f2b-e55df3444e8f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1106884896',display_name='tempest-VolumesAdminNegativeTest-server-1106884896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1106884896',id=6,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDErivDzfauF+a+hNvUNRpOBwCmvC7RxxqfuLyLQYFKMdLuSWG+n91VIWQ8yA+n+6cllrjjRmz8iAEwR8bI8o7EuIrn9NK1PTjkR9iBq+F7uENiwPssXh77uKOp99U34NQ==',key_name='tempest-keypair-1086129873',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:29:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cd2b878ead545479dc4546aab5a076e',ramdisk_id='',reservation_id='r-5t6mgt2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1417091548',owner_user_name='tempest-VolumesAdminNegativeTest-1417091548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3163e6f11b436f980f9ffc443d4d20',uuid=ff21d416-8ff1-49b5-9f2b-e55df3444e8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "address": "fa:16:3e:c0:a9:eb", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e24095-a5", "ovs_interfaceid": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Converting VIF {"id": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "address": "fa:16:3e:c0:a9:eb", "network": {"id": "cce3e40a-8298-47e4-a11c-138173306e63", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266425857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cd2b878ead545479dc4546aab5a076e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e24095-a5", "ovs_interfaceid": "f4e24095-a59c-4e7a-8339-8afb6230dde5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=f4e24095-a59c-4e7a-8339-8afb6230dde5,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e24095-a5') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG os_vif [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=f4e24095-a59c-4e7a-8339-8afb6230dde5,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e24095-a5') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4e24095-a5, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44befb53-7840-45e6-88f9-894006f9839e) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: INFO os_vif [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=f4e24095-a59c-4e7a-8339-8afb6230dde5,network=Network(cce3e40a-8298-47e4-a11c-138173306e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e24095-a5')
Nov 16 05:35:06 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Deleting instance files /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f_del
Nov 16 05:35:06 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Deletion of /opt/stack/data/nova/instances/ff21d416-8ff1-49b5-9f2b-e55df3444e8f_del complete
Nov 16 05:35:06 user nova-compute[80928]: INFO nova.compute.manager [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 16 05:35:06 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:35:06 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Waiting for libvirt event about the detach of device tapab94c533-de with device alias net1 from instance d9495878-bdc8-4448-9a96-a93168cca9dd is timed out.
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0a:57:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tapab94c533-de"/></interface> {{(pid=80928) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0a:57:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tapab94c533-de"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 16 05:35:06 user nova-compute[80928]:   <name>instance-00000010</name>
Nov 16 05:35:06 user nova-compute[80928]:   <uuid>d9495878-bdc8-4448-9a96-a93168cca9dd</uuid>
Nov 16 05:35:06 user nova-compute[80928]:   <metadata>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:35:06 user nova-compute[80928]:   <nova:package version="0.0.0"/>
Nov 16 05:35:06 user nova-compute[80928]:   <nova:name>tempest-device-tagging-server-448719116</nova:name>
Nov 16 05:35:06 user nova-compute[80928]:   <nova:creationTime>2023-11-16 05:34:13</nova:creationTime>
Nov 16 05:35:06 user nova-compute[80928]:   <nova:flavor name="m1.tiny">
Nov 16 05:35:06 user nova-compute[80928]:     <nova:memory>512</nova:memory>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:disk>1</nova:disk>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:swap>0</nova:swap>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:vcpus>1</nova:vcpus>
Nov 16 05:35:06 user nova-compute[80928]:   </nova:flavor>
Nov 16 05:35:06 user nova-compute[80928]:   <nova:owner>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:user uuid="aee02ffd699942259a6f10355af24e94">tempest-TaggedAttachmentsTest-878046877-project-member</nova:user>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:project uuid="d070f9d7fdfa47138f3f58b567211b71">tempest-TaggedAttachmentsTest-878046877</nova:project>
Nov 16 05:35:06 user nova-compute[80928]:   </nova:owner>
Nov 16 05:35:06 user nova-compute[80928]:   <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:35:06 user nova-compute[80928]:   <nova:ports>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:port uuid="5d98342e-40a0-4426-977e-b9c61886687b">
Nov 16 05:35:06 user nova-compute[80928]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 05:35:06 user nova-compute[80928]:     </nova:port>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:port uuid="ab94c533-dec6-4247-98b3-06659931293c">
Nov 16 05:35:06 user nova-compute[80928]:       <nova:ip type="fixed" address="10.10.10.157" ipVersion="4"/>
Nov 16 05:35:06 user nova-compute[80928]:     </nova:port>
Nov 16 05:35:06 user nova-compute[80928]:   </nova:ports>
Nov 16 05:35:06 user nova-compute[80928]: </nova:instance>
Nov 16 05:35:06 user nova-compute[80928]:   </metadata>
Nov 16 05:35:06 user nova-compute[80928]:   <memory unit='KiB'>524288</memory>
Nov 16 05:35:06 user nova-compute[80928]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 05:35:06 user nova-compute[80928]:   <vcpu placement='static'>1</vcpu>
Nov 16 05:35:06 user nova-compute[80928]:   <resource>
Nov 16 05:35:06 user nova-compute[80928]:     <partition>/machine</partition>
Nov 16 05:35:06 user nova-compute[80928]:   </resource>
Nov 16 05:35:06 user nova-compute[80928]:   <sysinfo type='smbios'>
Nov 16 05:35:06 user nova-compute[80928]:     <system>
Nov 16 05:35:06 user nova-compute[80928]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 05:35:06 user nova-compute[80928]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 05:35:06 user nova-compute[80928]:       <entry name='version'>0.0.0</entry>
Nov 16 05:35:06 user nova-compute[80928]:       <entry name='serial'>d9495878-bdc8-4448-9a96-a93168cca9dd</entry>
Nov 16 05:35:06 user nova-compute[80928]:       <entry name='uuid'>d9495878-bdc8-4448-9a96-a93168cca9dd</entry>
Nov 16 05:35:06 user nova-compute[80928]:       <entry name='family'>Virtual Machine</entry>
Nov 16 05:35:06 user nova-compute[80928]:     </system>
Nov 16 05:35:06 user nova-compute[80928]:   </sysinfo>
Nov 16 05:35:06 user nova-compute[80928]:   <os>
Nov 16 05:35:06 user nova-compute[80928]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 05:35:06 user nova-compute[80928]:     <boot dev='hd'/>
Nov 16 05:35:06 user nova-compute[80928]:     <smbios mode='sysinfo'/>
Nov 16 05:35:06 user nova-compute[80928]:   </os>
Nov 16 05:35:06 user nova-compute[80928]:   <features>
Nov 16 05:35:06 user nova-compute[80928]:     <acpi/>
Nov 16 05:35:06 user nova-compute[80928]:     <apic/>
Nov 16 05:35:06 user nova-compute[80928]:     <vmcoreinfo state='on'/>
Nov 16 05:35:06 user nova-compute[80928]:   </features>
Nov 16 05:35:06 user nova-compute[80928]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 05:35:06 user nova-compute[80928]:     <model fallback='forbid'>Nehalem</model>
Nov 16 05:35:06 user nova-compute[80928]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 05:35:06 user nova-compute[80928]:     <feature policy='require' name='vme'/>
Nov 16 05:35:06 user nova-compute[80928]:     <feature policy='require' name='x2apic'/>
Nov 16 05:35:06 user nova-compute[80928]:     <feature policy='require' name='hypervisor'/>
Nov 16 05:35:06 user nova-compute[80928]:   </cpu>
Nov 16 05:35:06 user nova-compute[80928]:   <clock offset='utc'>
Nov 16 05:35:06 user nova-compute[80928]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 05:35:06 user nova-compute[80928]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 05:35:06 user nova-compute[80928]:     <timer name='hpet' present='no'/>
Nov 16 05:35:06 user nova-compute[80928]:   </clock>
Nov 16 05:35:06 user nova-compute[80928]:   <on_poweroff>destroy</on_poweroff>
Nov 16 05:35:06 user nova-compute[80928]:   <on_reboot>restart</on_reboot>
Nov 16 05:35:06 user nova-compute[80928]:   <on_crash>destroy</on_crash>
Nov 16 05:35:06 user nova-compute[80928]:   <devices>
Nov 16 05:35:06 user nova-compute[80928]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 05:35:06 user nova-compute[80928]:     <disk type='file' device='disk'>
Nov 16 05:35:06 user nova-compute[80928]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 05:35:06 user nova-compute[80928]:       <source file='/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk' index='2'/>
Nov 16 05:35:06 user nova-compute[80928]:       <backingStore type='file' index='3'>
Nov 16 05:35:06 user nova-compute[80928]:         <format type='raw'/>
Nov 16 05:35:06 user nova-compute[80928]:         <source file='/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176'/>
Nov 16 05:35:06 user nova-compute[80928]:         <backingStore/>
Nov 16 05:35:06 user nova-compute[80928]:       </backingStore>
Nov 16 05:35:06 user nova-compute[80928]:       <target dev='vda' bus='virtio'/>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='virtio-disk0'/>
Nov 16 05:35:06 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 05:35:06 user nova-compute[80928]:     </disk>
Nov 16 05:35:06 user nova-compute[80928]:     <disk type='file' device='cdrom'>
Nov 16 05:35:06 user nova-compute[80928]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 05:35:06 user nova-compute[80928]:       <source file='/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/disk.config' index='1'/>
Nov 16 05:35:06 user nova-compute[80928]:       <backingStore/>
Nov 16 05:35:06 user nova-compute[80928]:       <target dev='hda' bus='ide'/>
Nov 16 05:35:06 user nova-compute[80928]:       <readonly/>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='ide0-0-0'/>
Nov 16 05:35:06 user nova-compute[80928]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 05:35:06 user nova-compute[80928]:     </disk>
Nov 16 05:35:06 user nova-compute[80928]:     <controller type='usb' index='0' model='none'>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='usb'/>
Nov 16 05:35:06 user nova-compute[80928]:     </controller>
Nov 16 05:35:06 user nova-compute[80928]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='pci.0'/>
Nov 16 05:35:06 user nova-compute[80928]:     </controller>
Nov 16 05:35:06 user nova-compute[80928]:     <controller type='ide' index='0'>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='ide'/>
Nov 16 05:35:06 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 05:35:06 user nova-compute[80928]:     </controller>
Nov 16 05:35:06 user nova-compute[80928]:     <interface type='ethernet'>
Nov 16 05:35:06 user nova-compute[80928]:       <mac address='fa:16:3e:9d:25:09'/>
Nov 16 05:35:06 user nova-compute[80928]:       <target dev='tap5d98342e-40'/>
Nov 16 05:35:06 user nova-compute[80928]:       <model type='virtio'/>
Nov 16 05:35:06 user nova-compute[80928]:       <mtu size='1442'/>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='net0'/>
Nov 16 05:35:06 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 05:35:06 user nova-compute[80928]:     </interface>
Nov 16 05:35:06 user nova-compute[80928]:     <serial type='pty'>
Nov 16 05:35:06 user nova-compute[80928]:       <source path='/dev/pts/10'/>
Nov 16 05:35:06 user nova-compute[80928]:       <log file='/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/console.log' append='off'/>
Nov 16 05:35:06 user nova-compute[80928]:       <target type='isa-serial' port='0'>
Nov 16 05:35:06 user nova-compute[80928]:         <model name='isa-serial'/>
Nov 16 05:35:06 user nova-compute[80928]:       </target>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='serial0'/>
Nov 16 05:35:06 user nova-compute[80928]:     </serial>
Nov 16 05:35:06 user nova-compute[80928]:     <console type='pty' tty='/dev/pts/10'>
Nov 16 05:35:06 user nova-compute[80928]:       <source path='/dev/pts/10'/>
Nov 16 05:35:06 user nova-compute[80928]:       <log file='/opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd/console.log' append='off'/>
Nov 16 05:35:06 user nova-compute[80928]:       <target type='serial' port='0'/>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='serial0'/>
Nov 16 05:35:06 user nova-compute[80928]:     </console>
Nov 16 05:35:06 user nova-compute[80928]:     <input type='mouse' bus='ps2'>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='input0'/>
Nov 16 05:35:06 user nova-compute[80928]:     </input>
Nov 16 05:35:06 user nova-compute[80928]:     <input type='keyboard' bus='ps2'>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='input1'/>
Nov 16 05:35:06 user nova-compute[80928]:     </input>
Nov 16 05:35:06 user nova-compute[80928]:     <graphics type='vnc' port='5912' autoport='yes' listen='0.0.0.0'>
Nov 16 05:35:06 user nova-compute[80928]:       <listen type='address' address='0.0.0.0'/>
Nov 16 05:35:06 user nova-compute[80928]:     </graphics>
Nov 16 05:35:06 user nova-compute[80928]:     <audio id='1' type='none'/>
Nov 16 05:35:06 user nova-compute[80928]:     <video>
Nov 16 05:35:06 user nova-compute[80928]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='video0'/>
Nov 16 05:35:06 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 05:35:06 user nova-compute[80928]:     </video>
Nov 16 05:35:06 user nova-compute[80928]:     <memballoon model='virtio'>
Nov 16 05:35:06 user nova-compute[80928]:       <stats period='10'/>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='balloon0'/>
Nov 16 05:35:06 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 05:35:06 user nova-compute[80928]:     </memballoon>
Nov 16 05:35:06 user nova-compute[80928]:     <rng model='virtio'>
Nov 16 05:35:06 user nova-compute[80928]:       <backend model='random'>/dev/urandom</backend>
Nov 16 05:35:06 user nova-compute[80928]:       <alias name='rng0'/>
Nov 16 05:35:06 user nova-compute[80928]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 05:35:06 user nova-compute[80928]:     </rng>
Nov 16 05:35:06 user nova-compute[80928]:   </devices>
Nov 16 05:35:06 user nova-compute[80928]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 05:35:06 user nova-compute[80928]:     <label>libvirt-d9495878-bdc8-4448-9a96-a93168cca9dd</label>
Nov 16 05:35:06 user nova-compute[80928]:     <imagelabel>libvirt-d9495878-bdc8-4448-9a96-a93168cca9dd</imagelabel>
Nov 16 05:35:06 user nova-compute[80928]:   </seclabel>
Nov 16 05:35:06 user nova-compute[80928]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 05:35:06 user nova-compute[80928]:     <label>+64055:+108</label>
Nov 16 05:35:06 user nova-compute[80928]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 05:35:06 user nova-compute[80928]:   </seclabel>
Nov 16 05:35:06 user nova-compute[80928]: </domain>
Nov 16 05:35:06 user nova-compute[80928]:  {{(pid=80928) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 05:35:06 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Successfully detached device tapab94c533-de from instance d9495878-bdc8-4448-9a96-a93168cca9dd from the live domain config.
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448719116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448719116',id=16,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbrfYM9Tfxryjx25pcrdzFi6aMDXg1GtvKXo5V5iWQ1HHL8WU/nWyrqQDT+9C4YMMZjtHiahtk+lIZb+3YjTrRbWV9Wq2Su/5MArY3ntN9SR2zMGcvMMV9nYJ5E0xygtw==',key_name='tempest-keypair-1199152231',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:32:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d070f9d7fdfa47138f3f58b567211b71',ramdisk_id='',reservation_id='r-6v774qk5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-878046877',owner_user_name='tempest-TaggedAttachmentsTest-878046877-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee02ffd699942259a6f10355af24e94',uuid=d9495878-bdc8-4448-9a96-a93168cca9dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab94c533-dec6-4247-98b3-06659931293c", "address": "fa:16:3e:0a:57:8a", "network": {"id": "6a41470f-2152-4682-b333-e3702141f978", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1925366456", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab94c533-de", "ovs_interfaceid": "ab94c533-dec6-4247-98b3-06659931293c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converting VIF {"id": "ab94c533-dec6-4247-98b3-06659931293c", "address": "fa:16:3e:0a:57:8a", "network": {"id": "6a41470f-2152-4682-b333-e3702141f978", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1925366456", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab94c533-de", "ovs_interfaceid": "ab94c533-dec6-4247-98b3-06659931293c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:57:8a,bridge_name='br-int',has_traffic_filtering=True,id=ab94c533-dec6-4247-98b3-06659931293c,network=Network(6a41470f-2152-4682-b333-e3702141f978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab94c533-de') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG os_vif [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:57:8a,bridge_name='br-int',has_traffic_filtering=True,id=ab94c533-dec6-4247-98b3-06659931293c,network=Network(6a41470f-2152-4682-b333-e3702141f978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab94c533-de') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab94c533-de, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45b681a3-d6b3-45d4-a731-40892ebf2ad5) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:06 user nova-compute[80928]: INFO os_vif [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:57:8a,bridge_name='br-int',has_traffic_filtering=True,id=ab94c533-dec6-4247-98b3-06659931293c,network=Network(6a41470f-2152-4682-b333-e3702141f978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab94c533-de')
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:35:06 user nova-compute[80928]:   <nova:package version="0.0.0"/>
Nov 16 05:35:06 user nova-compute[80928]:   <nova:name>tempest-device-tagging-server-448719116</nova:name>
Nov 16 05:35:06 user nova-compute[80928]:   <nova:creationTime>2023-11-16 05:35:06</nova:creationTime>
Nov 16 05:35:06 user nova-compute[80928]:   <nova:flavor name="m1.tiny">
Nov 16 05:35:06 user nova-compute[80928]:     <nova:memory>512</nova:memory>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:disk>1</nova:disk>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:swap>0</nova:swap>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:vcpus>1</nova:vcpus>
Nov 16 05:35:06 user nova-compute[80928]:   </nova:flavor>
Nov 16 05:35:06 user nova-compute[80928]:   <nova:owner>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:user uuid="aee02ffd699942259a6f10355af24e94">tempest-TaggedAttachmentsTest-878046877-project-member</nova:user>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:project uuid="d070f9d7fdfa47138f3f58b567211b71">tempest-TaggedAttachmentsTest-878046877</nova:project>
Nov 16 05:35:06 user nova-compute[80928]:   </nova:owner>
Nov 16 05:35:06 user nova-compute[80928]:   <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:35:06 user nova-compute[80928]:   <nova:ports>
Nov 16 05:35:06 user nova-compute[80928]:     <nova:port uuid="5d98342e-40a0-4426-977e-b9c61886687b">
Nov 16 05:35:06 user nova-compute[80928]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 05:35:06 user nova-compute[80928]:     </nova:port>
Nov 16 05:35:06 user nova-compute[80928]:   </nova:ports>
Nov 16 05:35:06 user nova-compute[80928]: </nova:instance>
Nov 16 05:35:06 user nova-compute[80928]:  {{(pid=80928) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-e9046ec2-c405-4daa-a87f-2c657cebacdb req-9828fc70-ac94-4b7e-a4ed-a5c75675f21d service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-changed-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-e9046ec2-c405-4daa-a87f-2c657cebacdb req-9828fc70-ac94-4b7e-a4ed-a5c75675f21d service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Refreshing instance network info cache due to event network-changed-42b5d66c-7f70-41b3-b29c-58333c62c7f2. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e9046ec2-c405-4daa-a87f-2c657cebacdb req-9828fc70-ac94-4b7e-a4ed-a5c75675f21d service nova] Acquiring lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e9046ec2-c405-4daa-a87f-2c657cebacdb req-9828fc70-ac94-4b7e-a4ed-a5c75675f21d service nova] Acquired lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:35:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-e9046ec2-c405-4daa-a87f-2c657cebacdb req-9828fc70-ac94-4b7e-a4ed-a5c75675f21d service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Refreshing network info cache for port 42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:35:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:35:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquired lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:35:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:35:07 user nova-compute[80928]: DEBUG nova.network.neutron [req-e9046ec2-c405-4daa-a87f-2c657cebacdb req-9828fc70-ac94-4b7e-a4ed-a5c75675f21d service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updated VIF entry in instance network info cache for port 42b5d66c-7f70-41b3-b29c-58333c62c7f2. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:35:07 user nova-compute[80928]: DEBUG nova.network.neutron [req-e9046ec2-c405-4daa-a87f-2c657cebacdb req-9828fc70-ac94-4b7e-a4ed-a5c75675f21d service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating instance_info_cache with network_info: [{"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:35:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e9046ec2-c405-4daa-a87f-2c657cebacdb req-9828fc70-ac94-4b7e-a4ed-a5c75675f21d service nova] Releasing lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:35:07 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:35:07 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Took 1.18 seconds to deallocate network for instance.
Nov 16 05:35:07 user nova-compute[80928]: INFO nova.network.neutron [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Port ab94c533-dec6-4247-98b3-06659931293c from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 16 05:35:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Updating instance_info_cache with network_info: [{"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:35:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Releasing lock "refresh_cache-d9495878-bdc8-4448-9a96-a93168cca9dd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:35:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b8dee4d6-f506-4f23-9354-6fa0fdba211d tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "interface-d9495878-bdc8-4448-9a96-a93168cca9dd-ab94c533-dec6-4247-98b3-06659931293c" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.660s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-a1eace68-34ba-4cb5-852d-6cb4b3a52c93 req-4f56f58e-6f29-48f6-a9ef-34134603e73c service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Received event network-vif-plugged-f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a1eace68-34ba-4cb5-852d-6cb4b3a52c93 req-4f56f58e-6f29-48f6-a9ef-34134603e73c service nova] Acquiring lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a1eace68-34ba-4cb5-852d-6cb4b3a52c93 req-4f56f58e-6f29-48f6-a9ef-34134603e73c service nova] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a1eace68-34ba-4cb5-852d-6cb4b3a52c93 req-4f56f58e-6f29-48f6-a9ef-34134603e73c service nova] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-a1eace68-34ba-4cb5-852d-6cb4b3a52c93 req-4f56f58e-6f29-48f6-a9ef-34134603e73c service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] No waiting events found dispatching network-vif-plugged-f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:08 user nova-compute[80928]: WARNING nova.compute.manager [req-a1eace68-34ba-4cb5-852d-6cb4b3a52c93 req-4f56f58e-6f29-48f6-a9ef-34134603e73c service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Received unexpected event network-vif-plugged-f4e24095-a59c-4e7a-8339-8afb6230dde5 for instance with vm_state deleted and task_state None.
Nov 16 05:35:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-a1eace68-34ba-4cb5-852d-6cb4b3a52c93 req-4f56f58e-6f29-48f6-a9ef-34134603e73c service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-vif-deleted-ab94c533-dec6-4247-98b3-06659931293c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:08 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:35:08 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:35:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:08 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Deleted allocations for instance ff21d416-8ff1-49b5-9f2b-e55df3444e8f
Nov 16 05:35:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70c617b2-8ab2-4d3d-abfe-0a7b173c70e2 tempest-VolumesAdminNegativeTest-1417091548 tempest-VolumesAdminNegativeTest-1417091548-project-member] Lock "ff21d416-8ff1-49b5-9f2b-e55df3444e8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.739s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-f6176b1d-fd49-4a38-b5f9-8d17099d5264 req-8b6f95d2-00ff-448f-95af-bc12d910164a service nova] [instance: ff21d416-8ff1-49b5-9f2b-e55df3444e8f] Received event network-vif-deleted-f4e24095-a59c-4e7a-8339-8afb6230dde5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "9b3672c1-d287-4caa-b022-aa088d51b97a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:34 user nova-compute[80928]: DEBUG nova.compute.manager [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:35:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:35:34 user nova-compute[80928]: INFO nova.compute.claims [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Claim successful on node user
Nov 16 05:35:35 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG nova.compute.manager [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG nova.compute.manager [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG nova.network.neutron [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:35:35 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:35:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG nova.compute.manager [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG nova.policy [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '952a7ea7e63649259b0b1e0df40c97d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f585dcb9e6cb432a9b04526ebc30e9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG nova.compute.manager [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:35:35 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Creating image(s)
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "/opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "/opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk 1073741824" returned: 0 in 0.050s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.network.neutron [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Successfully created port: bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Cannot resize image /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Ensure instance console log exists: /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.network.neutron [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Successfully updated port: bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "refresh_cache-9b3672c1-d287-4caa-b022-aa088d51b97a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquired lock "refresh_cache-9b3672c1-d287-4caa-b022-aa088d51b97a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.network.neutron [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [req-c0c982b6-0602-4dd0-84a8-9ee7cbd8c939 req-3f060d53-282f-4c78-8bc8-4347aef4b117 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Received event network-changed-bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [req-c0c982b6-0602-4dd0-84a8-9ee7cbd8c939 req-3f060d53-282f-4c78-8bc8-4347aef4b117 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Refreshing instance network info cache due to event network-changed-bcb8857b-e339-4e3f-909d-d687fc8481fd. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c0c982b6-0602-4dd0-84a8-9ee7cbd8c939 req-3f060d53-282f-4c78-8bc8-4347aef4b117 service nova] Acquiring lock "refresh_cache-9b3672c1-d287-4caa-b022-aa088d51b97a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.network.neutron [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_power_states {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:35:36 user nova-compute[80928]: WARNING nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 8292134f-09d4-4240-94bb-281e6c236d09 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 5d03bda0-20b8-497a-a87b-faee21624468 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 762caa99-5c4a-428d-8059-7903d0bdb149 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid a39e1ed9-2651-4de2-8979-c030b02b0ee1 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid d9495878-bdc8-4448-9a96-a93168cca9dd {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid b0211dc5-730f-435b-8d39-3a1606a7696f {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid c7409e6d-ea55-41eb-8fab-9fd6a42d21cb {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 9b3672c1-d287-4caa-b022-aa088d51b97a {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 859f06da-737e-40c3-9e85-2fd33052a9ea {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "8292134f-09d4-4240-94bb-281e6c236d09" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "8292134f-09d4-4240-94bb-281e6c236d09" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "5d03bda0-20b8-497a-a87b-faee21624468" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "5d03bda0-20b8-497a-a87b-faee21624468" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "762caa99-5c4a-428d-8059-7903d0bdb149" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "762caa99-5c4a-428d-8059-7903d0bdb149" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "9b3672c1-d287-4caa-b022-aa088d51b97a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:37 user nova-compute[80928]: WARNING oslo_messaging._drivers.amqpdriver [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "5d03bda0-20b8-497a-a87b-faee21624468" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:37 user nova-compute[80928]: INFO nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "8292134f-09d4-4240-94bb-281e6c236d09" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "762caa99-5c4a-428d-8059-7903d0bdb149" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:37 user nova-compute[80928]: INFO nova.compute.manager [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Terminating instance
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.network.neutron [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Updating instance_info_cache with network_info: [{"id": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "address": "fa:16:3e:f0:11:e0", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb8857b-e3", "ovs_interfaceid": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Releasing lock "refresh_cache-9b3672c1-d287-4caa-b022-aa088d51b97a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Instance network_info: |[{"id": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "address": "fa:16:3e:f0:11:e0", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb8857b-e3", "ovs_interfaceid": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c0c982b6-0602-4dd0-84a8-9ee7cbd8c939 req-3f060d53-282f-4c78-8bc8-4347aef4b117 service nova] Acquired lock "refresh_cache-9b3672c1-d287-4caa-b022-aa088d51b97a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.network.neutron [req-c0c982b6-0602-4dd0-84a8-9ee7cbd8c939 req-3f060d53-282f-4c78-8bc8-4347aef4b117 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Refreshing network info cache for port bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Start _get_guest_xml network_info=[{"id": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "address": "fa:16:3e:f0:11:e0", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb8857b-e3", "ovs_interfaceid": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:35:37 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:35:37 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1702849269',display_name='tempest-AttachVolumeNegativeTest-server-1702849269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1702849269',id=22,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc80cj/q5VLkhluo2ro9rFnCF8aTeikgGdq/YF3w7ZNeYuxKF+aSwi0ZeXxP9xjmq5fcH2jiIAvrF/iPzUYWxjaYsiiuvSk6Om13xNLxKA05f8mXVslP4H1vnua6LRllA==',key_name='tempest-keypair-875834071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f585dcb9e6cb432a9b04526ebc30e9d8',ramdisk_id='',reservation_id='r-g3qew1dv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-155531213',owner_user_name='tempest-AttachVolumeNegativeTest-155531213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952a7ea7e63649259b0b1e0df40c97d0',uuid=9b3672c1-d287-4caa-b022-aa088d51b97a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "address": "fa:16:3e:f0:11:e0", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb8857b-e3", "ovs_interfaceid": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converting VIF {"id": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "address": "fa:16:3e:f0:11:e0", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb8857b-e3", "ovs_interfaceid": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:e0,bridge_name='br-int',has_traffic_filtering=True,id=bcb8857b-e339-4e3f-909d-d687fc8481fd,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb8857b-e3') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.objects.instance [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b3672c1-d287-4caa-b022-aa088d51b97a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:35:37 user nova-compute[80928]:   <uuid>9b3672c1-d287-4caa-b022-aa088d51b97a</uuid>
Nov 16 05:35:37 user nova-compute[80928]:   <name>instance-00000016</name>
Nov 16 05:35:37 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:35:37 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:35:37 user nova-compute[80928]:   <metadata>
Nov 16 05:35:37 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:35:37 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:35:37 user nova-compute[80928]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1702849269</nova:name>
Nov 16 05:35:37 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:35:37</nova:creationTime>
Nov 16 05:35:37 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:35:37 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:35:37 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:35:37 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:35:37 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:35:37 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:35:37 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:35:37 user nova-compute[80928]:       <nova:owner>
Nov 16 05:35:37 user nova-compute[80928]:         <nova:user uuid="952a7ea7e63649259b0b1e0df40c97d0">tempest-AttachVolumeNegativeTest-155531213-project-member</nova:user>
Nov 16 05:35:37 user nova-compute[80928]:         <nova:project uuid="f585dcb9e6cb432a9b04526ebc30e9d8">tempest-AttachVolumeNegativeTest-155531213</nova:project>
Nov 16 05:35:37 user nova-compute[80928]:       </nova:owner>
Nov 16 05:35:37 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:35:37 user nova-compute[80928]:       <nova:ports>
Nov 16 05:35:37 user nova-compute[80928]:         <nova:port uuid="bcb8857b-e339-4e3f-909d-d687fc8481fd">
Nov 16 05:35:37 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:35:37 user nova-compute[80928]:         </nova:port>
Nov 16 05:35:37 user nova-compute[80928]:       </nova:ports>
Nov 16 05:35:37 user nova-compute[80928]:     </nova:instance>
Nov 16 05:35:37 user nova-compute[80928]:   </metadata>
Nov 16 05:35:37 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:35:37 user nova-compute[80928]:     <system>
Nov 16 05:35:37 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:35:37 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:35:37 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:35:37 user nova-compute[80928]:       <entry name="serial">9b3672c1-d287-4caa-b022-aa088d51b97a</entry>
Nov 16 05:35:37 user nova-compute[80928]:       <entry name="uuid">9b3672c1-d287-4caa-b022-aa088d51b97a</entry>
Nov 16 05:35:37 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:35:37 user nova-compute[80928]:     </system>
Nov 16 05:35:37 user nova-compute[80928]:   </sysinfo>
Nov 16 05:35:37 user nova-compute[80928]:   <os>
Nov 16 05:35:37 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:35:37 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:35:37 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:35:37 user nova-compute[80928]:   </os>
Nov 16 05:35:37 user nova-compute[80928]:   <features>
Nov 16 05:35:37 user nova-compute[80928]:     <acpi/>
Nov 16 05:35:37 user nova-compute[80928]:     <apic/>
Nov 16 05:35:37 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:35:37 user nova-compute[80928]:   </features>
Nov 16 05:35:37 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:35:37 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:35:37 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:35:37 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:35:37 user nova-compute[80928]:   </clock>
Nov 16 05:35:37 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:35:37 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:35:37 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:35:37 user nova-compute[80928]:   </cpu>
Nov 16 05:35:37 user nova-compute[80928]:   <devices>
Nov 16 05:35:37 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:35:37 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:35:37 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk"/>
Nov 16 05:35:37 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:35:37 user nova-compute[80928]:     </disk>
Nov 16 05:35:37 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:35:37 user nova-compute[80928]:       <mac address="fa:16:3e:f0:11:e0"/>
Nov 16 05:35:37 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:35:37 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:35:37 user nova-compute[80928]:       <target dev="tapbcb8857b-e3"/>
Nov 16 05:35:37 user nova-compute[80928]:     </interface>
Nov 16 05:35:37 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:35:37 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/console.log" append="off"/>
Nov 16 05:35:37 user nova-compute[80928]:     </serial>
Nov 16 05:35:37 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:35:37 user nova-compute[80928]:     <video>
Nov 16 05:35:37 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:35:37 user nova-compute[80928]:     </video>
Nov 16 05:35:37 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:35:37 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:35:37 user nova-compute[80928]:     </rng>
Nov 16 05:35:37 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:35:37 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:35:37 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:35:37 user nova-compute[80928]:     </memballoon>
Nov 16 05:35:37 user nova-compute[80928]:   </devices>
Nov 16 05:35:37 user nova-compute[80928]: </domain>
Nov 16 05:35:37 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1702849269',display_name='tempest-AttachVolumeNegativeTest-server-1702849269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1702849269',id=22,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc80cj/q5VLkhluo2ro9rFnCF8aTeikgGdq/YF3w7ZNeYuxKF+aSwi0ZeXxP9xjmq5fcH2jiIAvrF/iPzUYWxjaYsiiuvSk6Om13xNLxKA05f8mXVslP4H1vnua6LRllA==',key_name='tempest-keypair-875834071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f585dcb9e6cb432a9b04526ebc30e9d8',ramdisk_id='',reservation_id='r-g3qew1dv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-155531213',owner_user_name='tempest-AttachVolumeNegativeTest-155531213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952a7ea7e63649259b0b1e0df40c97d0',uuid=9b3672c1-d287-4caa-b022-aa088d51b97a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "address": "fa:16:3e:f0:11:e0", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb8857b-e3", "ovs_interfaceid": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converting VIF {"id": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "address": "fa:16:3e:f0:11:e0", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb8857b-e3", "ovs_interfaceid": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:e0,bridge_name='br-int',has_traffic_filtering=True,id=bcb8857b-e339-4e3f-909d-d687fc8481fd,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb8857b-e3') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG os_vif [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:e0,bridge_name='br-int',has_traffic_filtering=True,id=bcb8857b-e339-4e3f-909d-d687fc8481fd,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb8857b-e3') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cff2e192-3892-5cf1-bfce-35d173a5694b', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcb8857b-e3, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcb8857b-e3, col_values=(('qos', UUID('024535d3-b1cd-4544-9af8-c7223871004c')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcb8857b-e3, col_values=(('external_ids', {'iface-id': 'bcb8857b-e339-4e3f-909d-d687fc8481fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:11:e0', 'vm-uuid': '9b3672c1-d287-4caa-b022-aa088d51b97a'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:37 user nova-compute[80928]: INFO os_vif [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:e0,bridge_name='br-int',has_traffic_filtering=True,id=bcb8857b-e339-4e3f-909d-d687fc8481fd,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb8857b-e3')
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:35:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No VIF found with MAC fa:16:3e:f0:11:e0, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG nova.network.neutron [req-c0c982b6-0602-4dd0-84a8-9ee7cbd8c939 req-3f060d53-282f-4c78-8bc8-4347aef4b117 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Updated VIF entry in instance network info cache for port bcb8857b-e339-4e3f-909d-d687fc8481fd. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG nova.network.neutron [req-c0c982b6-0602-4dd0-84a8-9ee7cbd8c939 req-3f060d53-282f-4c78-8bc8-4347aef4b117 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Updating instance_info_cache with network_info: [{"id": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "address": "fa:16:3e:f0:11:e0", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb8857b-e3", "ovs_interfaceid": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c0c982b6-0602-4dd0-84a8-9ee7cbd8c939 req-3f060d53-282f-4c78-8bc8-4347aef4b117 service nova] Releasing lock "refresh_cache-9b3672c1-d287-4caa-b022-aa088d51b97a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:35:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Instance destroyed successfully.
Nov 16 05:35:38 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lazy-loading 'resources' on Instance uuid d9495878-bdc8-4448-9a96-a93168cca9dd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448719116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448719116',id=16,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbrfYM9Tfxryjx25pcrdzFi6aMDXg1GtvKXo5V5iWQ1HHL8WU/nWyrqQDT+9C4YMMZjtHiahtk+lIZb+3YjTrRbWV9Wq2Su/5MArY3ntN9SR2zMGcvMMV9nYJ5E0xygtw==',key_name='tempest-keypair-1199152231',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:32:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d070f9d7fdfa47138f3f58b567211b71',ramdisk_id='',reservation_id='r-6v774qk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-878046877',owner_user_name='tempest-TaggedAttachmentsTest-878046877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aee02ffd699942259a6f10355af24e94',uuid=d9495878-bdc8-4448-9a96-a93168cca9dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converting VIF {"id": "5d98342e-40a0-4426-977e-b9c61886687b", "address": "fa:16:3e:9d:25:09", "network": {"id": "188b965c-0cdc-4666-8723-052455c279ad", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-865245147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d070f9d7fdfa47138f3f58b567211b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d98342e-40", "ovs_interfaceid": "5d98342e-40a0-4426-977e-b9c61886687b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:25:09,bridge_name='br-int',has_traffic_filtering=True,id=5d98342e-40a0-4426-977e-b9c61886687b,network=Network(188b965c-0cdc-4666-8723-052455c279ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d98342e-40') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG os_vif [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:25:09,bridge_name='br-int',has_traffic_filtering=True,id=5d98342e-40a0-4426-977e-b9c61886687b,network=Network(188b965c-0cdc-4666-8723-052455c279ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d98342e-40') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d98342e-40, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11e3a521-f17f-41b6-a346-24215326db37) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:38 user nova-compute[80928]: INFO os_vif [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:25:09,bridge_name='br-int',has_traffic_filtering=True,id=5d98342e-40a0-4426-977e-b9c61886687b,network=Network(188b965c-0cdc-4666-8723-052455c279ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d98342e-40')
Nov 16 05:35:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Deleting instance files /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd_del
Nov 16 05:35:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Deletion of /opt/stack/data/nova/instances/d9495878-bdc8-4448-9a96-a93168cca9dd_del complete
Nov 16 05:35:38 user nova-compute[80928]: INFO nova.compute.manager [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 16 05:35:38 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:35:38 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-b3144621-f2a3-4832-95f8-7ce298c8b67d req-dbbef030-e2ae-4b91-a793-b90474079682 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-vif-unplugged-5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b3144621-f2a3-4832-95f8-7ce298c8b67d req-dbbef030-e2ae-4b91-a793-b90474079682 service nova] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b3144621-f2a3-4832-95f8-7ce298c8b67d req-dbbef030-e2ae-4b91-a793-b90474079682 service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b3144621-f2a3-4832-95f8-7ce298c8b67d req-dbbef030-e2ae-4b91-a793-b90474079682 service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-b3144621-f2a3-4832-95f8-7ce298c8b67d req-dbbef030-e2ae-4b91-a793-b90474079682 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] No waiting events found dispatching network-vif-unplugged-5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-b3144621-f2a3-4832-95f8-7ce298c8b67d req-dbbef030-e2ae-4b91-a793-b90474079682 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-vif-unplugged-5d98342e-40a0-4426-977e-b9c61886687b for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-b3144621-f2a3-4832-95f8-7ce298c8b67d req-dbbef030-e2ae-4b91-a793-b90474079682 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-vif-plugged-5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b3144621-f2a3-4832-95f8-7ce298c8b67d req-dbbef030-e2ae-4b91-a793-b90474079682 service nova] Acquiring lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b3144621-f2a3-4832-95f8-7ce298c8b67d req-dbbef030-e2ae-4b91-a793-b90474079682 service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b3144621-f2a3-4832-95f8-7ce298c8b67d req-dbbef030-e2ae-4b91-a793-b90474079682 service nova] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-b3144621-f2a3-4832-95f8-7ce298c8b67d req-dbbef030-e2ae-4b91-a793-b90474079682 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] No waiting events found dispatching network-vif-plugged-5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:39 user nova-compute[80928]: WARNING nova.compute.manager [req-b3144621-f2a3-4832-95f8-7ce298c8b67d req-dbbef030-e2ae-4b91-a793-b90474079682 service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received unexpected event network-vif-plugged-5d98342e-40a0-4426-977e-b9c61886687b for instance with vm_state active and task_state deleting.
Nov 16 05:35:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:35:39 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Took 0.98 seconds to deallocate network for instance.
Nov 16 05:35:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-e4ee78d3-e082-4a02-8c38-246e7b81897a req-8b90db15-6674-48b9-a648-30c36401c81f service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Received event network-vif-plugged-bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e4ee78d3-e082-4a02-8c38-246e7b81897a req-8b90db15-6674-48b9-a648-30c36401c81f service nova] Acquiring lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e4ee78d3-e082-4a02-8c38-246e7b81897a req-8b90db15-6674-48b9-a648-30c36401c81f service nova] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e4ee78d3-e082-4a02-8c38-246e7b81897a req-8b90db15-6674-48b9-a648-30c36401c81f service nova] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-e4ee78d3-e082-4a02-8c38-246e7b81897a req-8b90db15-6674-48b9-a648-30c36401c81f service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] No waiting events found dispatching network-vif-plugged-bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:39 user nova-compute[80928]: WARNING nova.compute.manager [req-e4ee78d3-e082-4a02-8c38-246e7b81897a req-8b90db15-6674-48b9-a648-30c36401c81f service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Received unexpected event network-vif-plugged-bcb8857b-e339-4e3f-909d-d687fc8481fd for instance with vm_state building and task_state spawning.
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:39 user nova-compute[80928]: INFO nova.compute.manager [None req-0f4f1b62-0c7e-4ebd-9bbf-63f3548a407a tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Unrescuing
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0f4f1b62-0c7e-4ebd-9bbf-63f3548a407a tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0f4f1b62-0c7e-4ebd-9bbf-63f3548a407a tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquired lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0f4f1b62-0c7e-4ebd-9bbf-63f3548a407a tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:39 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:40 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Deleted allocations for instance d9495878-bdc8-4448-9a96-a93168cca9dd
Nov 16 05:35:40 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0f4f1b62-0c7e-4ebd-9bbf-63f3548a407a tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Updating instance_info_cache with network_info: [{"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0f4f1b62-0c7e-4ebd-9bbf-63f3548a407a tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Releasing lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG nova.objects.instance [None req-0f4f1b62-0c7e-4ebd-9bbf-63f3548a407a tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'flavor' on Instance uuid a39e1ed9-2651-4de2-8979-c030b02b0ee1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f1523ea4-3e4a-474f-9f0e-5ba1f9069e83 tempest-TaggedAttachmentsTest-878046877 tempest-TaggedAttachmentsTest-878046877-project-member] Lock "d9495878-bdc8-4448-9a96-a93168cca9dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.156s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-58000ffc-fe5e-4920-a535-2d2b25dfb0b4 req-2e2c8033-2bc1-4e24-b9fa-1dd9e33cd04d service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-unplugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-58000ffc-fe5e-4920-a535-2d2b25dfb0b4 req-2e2c8033-2bc1-4e24-b9fa-1dd9e33cd04d service nova] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-58000ffc-fe5e-4920-a535-2d2b25dfb0b4 req-2e2c8033-2bc1-4e24-b9fa-1dd9e33cd04d service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-58000ffc-fe5e-4920-a535-2d2b25dfb0b4 req-2e2c8033-2bc1-4e24-b9fa-1dd9e33cd04d service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-58000ffc-fe5e-4920-a535-2d2b25dfb0b4 req-2e2c8033-2bc1-4e24-b9fa-1dd9e33cd04d service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] No waiting events found dispatching network-vif-unplugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:40 user nova-compute[80928]: WARNING nova.compute.manager [req-58000ffc-fe5e-4920-a535-2d2b25dfb0b4 req-2e2c8033-2bc1-4e24-b9fa-1dd9e33cd04d service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received unexpected event network-vif-unplugged-af4426f7-2ac8-4035-98b1-7739d2acf95b for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:35:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Instance destroyed successfully.
Nov 16 05:35:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-1ed94370-d016-4645-9251-1224dd93da15 req-6d529761-9c09-4f8f-8e49-7a44274dce7a service nova] [instance: d9495878-bdc8-4448-9a96-a93168cca9dd] Received event network-vif-deleted-5d98342e-40a0-4426-977e-b9c61886687b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-2fb4febb-e089-40aa-a204-d9ee2b708858 req-2d0cd605-0d19-45bc-b9ed-1f416eaa39f9 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Received event network-vif-plugged-bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2fb4febb-e089-40aa-a204-d9ee2b708858 req-2d0cd605-0d19-45bc-b9ed-1f416eaa39f9 service nova] Acquiring lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2fb4febb-e089-40aa-a204-d9ee2b708858 req-2d0cd605-0d19-45bc-b9ed-1f416eaa39f9 service nova] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2fb4febb-e089-40aa-a204-d9ee2b708858 req-2d0cd605-0d19-45bc-b9ed-1f416eaa39f9 service nova] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-2fb4febb-e089-40aa-a204-d9ee2b708858 req-2d0cd605-0d19-45bc-b9ed-1f416eaa39f9 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] No waiting events found dispatching network-vif-plugged-bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:41 user nova-compute[80928]: WARNING nova.compute.manager [req-2fb4febb-e089-40aa-a204-d9ee2b708858 req-2d0cd605-0d19-45bc-b9ed-1f416eaa39f9 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Received unexpected event network-vif-plugged-bcb8857b-e339-4e3f-909d-d687fc8481fd for instance with vm_state building and task_state spawning.
Nov 16 05:35:41 user nova-compute[80928]: DEBUG nova.compute.manager [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:35:41 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Instance spawned successfully.
Nov 16 05:35:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:35:41 user nova-compute[80928]: INFO nova.compute.manager [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 16 05:35:41 user nova-compute[80928]: DEBUG nova.compute.manager [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:35:41 user nova-compute[80928]: INFO nova.compute.manager [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Took 7.03 seconds to build instance.
Nov 16 05:35:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-23975229-1d12-46c8-8b3b-ad11f66e6d67 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.120s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.814s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:41 user nova-compute[80928]: INFO nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 16 05:35:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-9930d45a-6efc-4f21-a02b-f7053bb4246c req-43431c8c-33d3-4a58-a2a6-8221bfbccce1 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9930d45a-6efc-4f21-a02b-f7053bb4246c req-43431c8c-33d3-4a58-a2a6-8221bfbccce1 service nova] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9930d45a-6efc-4f21-a02b-f7053bb4246c req-43431c8c-33d3-4a58-a2a6-8221bfbccce1 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9930d45a-6efc-4f21-a02b-f7053bb4246c req-43431c8c-33d3-4a58-a2a6-8221bfbccce1 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-9930d45a-6efc-4f21-a02b-f7053bb4246c req-43431c8c-33d3-4a58-a2a6-8221bfbccce1 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] No waiting events found dispatching network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:42 user nova-compute[80928]: WARNING nova.compute.manager [req-9930d45a-6efc-4f21-a02b-f7053bb4246c req-43431c8c-33d3-4a58-a2a6-8221bfbccce1 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received unexpected event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:35:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-f41ef50e-1e93-4524-9207-c5c2dcf164b3 req-4c5eadda-d053-4ea7-91f0-a47bb7466e03 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f41ef50e-1e93-4524-9207-c5c2dcf164b3 req-4c5eadda-d053-4ea7-91f0-a47bb7466e03 service nova] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f41ef50e-1e93-4524-9207-c5c2dcf164b3 req-4c5eadda-d053-4ea7-91f0-a47bb7466e03 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f41ef50e-1e93-4524-9207-c5c2dcf164b3 req-4c5eadda-d053-4ea7-91f0-a47bb7466e03 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-f41ef50e-1e93-4524-9207-c5c2dcf164b3 req-4c5eadda-d053-4ea7-91f0-a47bb7466e03 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] No waiting events found dispatching network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:44 user nova-compute[80928]: WARNING nova.compute.manager [req-f41ef50e-1e93-4524-9207-c5c2dcf164b3 req-4c5eadda-d053-4ea7-91f0-a47bb7466e03 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received unexpected event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:35:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-f41ef50e-1e93-4524-9207-c5c2dcf164b3 req-4c5eadda-d053-4ea7-91f0-a47bb7466e03 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f41ef50e-1e93-4524-9207-c5c2dcf164b3 req-4c5eadda-d053-4ea7-91f0-a47bb7466e03 service nova] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f41ef50e-1e93-4524-9207-c5c2dcf164b3 req-4c5eadda-d053-4ea7-91f0-a47bb7466e03 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f41ef50e-1e93-4524-9207-c5c2dcf164b3 req-4c5eadda-d053-4ea7-91f0-a47bb7466e03 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-f41ef50e-1e93-4524-9207-c5c2dcf164b3 req-4c5eadda-d053-4ea7-91f0-a47bb7466e03 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] No waiting events found dispatching network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:44 user nova-compute[80928]: WARNING nova.compute.manager [req-f41ef50e-1e93-4524-9207-c5c2dcf164b3 req-4c5eadda-d053-4ea7-91f0-a47bb7466e03 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received unexpected event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:35:44 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0f4f1b62-0c7e-4ebd-9bbf-63f3548a407a tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:35:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:35:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:35:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:35:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:35:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:53 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:35:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-9f8fb6bb-8f38-4fb2-8d1e-84fd861a7e7d req-58f4ccc0-84de-4749-9016-2c69420da2d2 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event network-changed-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:54 user nova-compute[80928]: DEBUG nova.compute.manager [req-9f8fb6bb-8f38-4fb2-8d1e-84fd861a7e7d req-58f4ccc0-84de-4749-9016-2c69420da2d2 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Refreshing instance network info cache due to event network-changed-4acbefc0-9505-48d7-9718-581771fcd450. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:35:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9f8fb6bb-8f38-4fb2-8d1e-84fd861a7e7d req-58f4ccc0-84de-4749-9016-2c69420da2d2 service nova] Acquiring lock "refresh_cache-b0211dc5-730f-435b-8d39-3a1606a7696f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:35:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9f8fb6bb-8f38-4fb2-8d1e-84fd861a7e7d req-58f4ccc0-84de-4749-9016-2c69420da2d2 service nova] Acquired lock "refresh_cache-b0211dc5-730f-435b-8d39-3a1606a7696f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:35:54 user nova-compute[80928]: DEBUG nova.network.neutron [req-9f8fb6bb-8f38-4fb2-8d1e-84fd861a7e7d req-58f4ccc0-84de-4749-9016-2c69420da2d2 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Refreshing network info cache for port 4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG nova.network.neutron [req-9f8fb6bb-8f38-4fb2-8d1e-84fd861a7e7d req-58f4ccc0-84de-4749-9016-2c69420da2d2 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Updated VIF entry in instance network info cache for port 4acbefc0-9505-48d7-9718-581771fcd450. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG nova.network.neutron [req-9f8fb6bb-8f38-4fb2-8d1e-84fd861a7e7d req-58f4ccc0-84de-4749-9016-2c69420da2d2 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Updating instance_info_cache with network_info: [{"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9f8fb6bb-8f38-4fb2-8d1e-84fd861a7e7d req-58f4ccc0-84de-4749-9016-2c69420da2d2 service nova] Releasing lock "refresh_cache-b0211dc5-730f-435b-8d39-3a1606a7696f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:55 user nova-compute[80928]: INFO nova.compute.manager [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Rebuilding instance
Nov 16 05:35:55 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-21edfba0-e10a-4d44-bffe-7e257d5f3531 req-62779536-506e-4cdb-af75-cc3ee9cec5ab service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event network-vif-unplugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-21edfba0-e10a-4d44-bffe-7e257d5f3531 req-62779536-506e-4cdb-af75-cc3ee9cec5ab service nova] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-21edfba0-e10a-4d44-bffe-7e257d5f3531 req-62779536-506e-4cdb-af75-cc3ee9cec5ab service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-21edfba0-e10a-4d44-bffe-7e257d5f3531 req-62779536-506e-4cdb-af75-cc3ee9cec5ab service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-21edfba0-e10a-4d44-bffe-7e257d5f3531 req-62779536-506e-4cdb-af75-cc3ee9cec5ab service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] No waiting events found dispatching network-vif-unplugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:35:55 user nova-compute[80928]: WARNING nova.compute.manager [req-21edfba0-e10a-4d44-bffe-7e257d5f3531 req-62779536-506e-4cdb-af75-cc3ee9cec5ab service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received unexpected event network-vif-unplugged-4acbefc0-9505-48d7-9718-581771fcd450 for instance with vm_state active and task_state rebuilding.
Nov 16 05:35:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Instance destroyed successfully.
Nov 16 05:35:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Instance destroyed successfully.
Nov 16 05:35:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1081583894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1342069825',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrww7sI55a3Trl1PjEiEIP4wlwDIEoLgs3TLCjEDtdyvuCgUJTQf3YJE0l8HAZq4ews1teuYYbO2FrUVPNoHQVhYuYAl1+w8B/UHR4F7VdE+bpMzQtOmJVEPqskAogcEg==',key_name='tempest-keypair-1036640328',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dde93358753b405293c50a4eb65a55a8',ramdisk_id='',reservation_id='r-bx9ws9wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1532463154',owner_user_name='tempest-ServerActionsV293TestJSON-1532463154-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:35:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce09fc1320c4033baf06caf7282676a',uuid=b0211dc5-730f-435b-8d39-3a1606a7696f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Converting VIF {"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_vif [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4acbefc0-95, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06d08fdd-6040-41fc-8ca7-a306fe4e2b77) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:35:56 user nova-compute[80928]: INFO os_vif [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95')
Nov 16 05:35:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjFwbycI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:35:56 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7e9cd6-9eff-40fe-a23a-834420f669cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:35:56 user nova-compute[80928]: No targets found.
Nov 16 05:35:56 user nova-compute[80928]: iSNS:
Nov 16 05:35:56 user nova-compute[80928]: No targets found.
Nov 16 05:35:56 user nova-compute[80928]: STATIC:
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: FIRMWARE:
Nov 16 05:35:56 user nova-compute[80928]: No targets found.
Nov 16 05:35:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:35:56 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:35:56 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4682f586-bf73-4636-a379-161f0c8bef1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c75d99-31fd-4438-8dfd-99ef21a6361f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585ce440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf251fe-6998-4e7d-be42-219baa17f6f3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[176e30e8-f1ce-4a1b-b684-3d37147950fe]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5c68a1-94d3-4e6b-8ef0-5ba2f5db3b06]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[44078112-b154-4dd6-a45e-c61d6642b1f6]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f62884d-6aec-43f5-8567-be9d629dfc9a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3cbb65-8982-4710-a7e4-8c5e23867e19]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260]
Nov 16 05:35:56 user nova-compute[80928]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260] successful.
Nov 16 05:35:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13fafed-eb92-4347-9b06-e778c17f2fda]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] <== disconnect_volume: return (352ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:35:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Deleting instance files /opt/stack/data/nova/instances/b0211dc5-730f-435b-8d39-3a1606a7696f_del
Nov 16 05:35:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Deletion of /opt/stack/data/nova/instances/b0211dc5-730f-435b-8d39-3a1606a7696f_del complete
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:35:56 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance b0211dc5-730f-435b-8d39-3a1606a7696f could not be found.
Nov 16 05:35:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjFwbycI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:35:56 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[286598d3-b85a-4364-a975-2dcf757012f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:35:56 user nova-compute[80928]: No targets found.
Nov 16 05:35:56 user nova-compute[80928]: iSNS:
Nov 16 05:35:56 user nova-compute[80928]: No targets found.
Nov 16 05:35:56 user nova-compute[80928]: STATIC:
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0
Nov 16 05:35:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:35:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:35:56 user nova-compute[80928]: FIRMWARE:
Nov 16 05:35:56 user nova-compute[80928]: No targets found.
Nov 16 05:35:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:35:56 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:35:56 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9093db90-f8e4-49f7-85ba-3d21423d4419]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[871c03e8-de7e-44f6-bd2c-90307ac045ed]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:35:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86781268c0>, {}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Disconnecting from: [] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] <== disconnect_volume: return (86ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:35:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:35:57 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:35:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:35:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 05:35:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-ad456759-80bc-4873-92fc-b831744937f3 req-97fd1a83-ffba-4919-bfaa-e9ae91da654a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-changed-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-ad456759-80bc-4873-92fc-b831744937f3 req-97fd1a83-ffba-4919-bfaa-e9ae91da654a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing instance network info cache due to event network-changed-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:35:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ad456759-80bc-4873-92fc-b831744937f3 req-97fd1a83-ffba-4919-bfaa-e9ae91da654a service nova] Acquiring lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:35:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ad456759-80bc-4873-92fc-b831744937f3 req-97fd1a83-ffba-4919-bfaa-e9ae91da654a service nova] Acquired lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:35:57 user nova-compute[80928]: DEBUG nova.network.neutron [req-ad456759-80bc-4873-92fc-b831744937f3 req-97fd1a83-ffba-4919-bfaa-e9ae91da654a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Refreshing network info cache for port 9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:35:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Preparing to wait for external event volume-reimaged-35e4c943-129b-442f-89c6-7923123c3ed7 {{(pid=80928) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 16 05:35:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:35:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:35:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:35:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 8292134f-09d4-4240-94bb-281e6c236d09 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:35:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-15104d45-ac1f-4ac2-9c8f-939af2f9a1b2 req-f4888149-9843-42ac-93b4-0955440b081c service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:35:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-15104d45-ac1f-4ac2-9c8f-939af2f9a1b2 req-f4888149-9843-42ac-93b4-0955440b081c service nova] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-15104d45-ac1f-4ac2-9c8f-939af2f9a1b2 req-f4888149-9843-42ac-93b4-0955440b081c service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-15104d45-ac1f-4ac2-9c8f-939af2f9a1b2 req-f4888149-9843-42ac-93b4-0955440b081c service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-15104d45-ac1f-4ac2-9c8f-939af2f9a1b2 req-f4888149-9843-42ac-93b4-0955440b081c service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] No event matching network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 in dict_keys([('volume-reimaged', '35e4c943-129b-442f-89c6-7923123c3ed7')]) {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 16 05:35:58 user nova-compute[80928]: WARNING nova.compute.manager [req-15104d45-ac1f-4ac2-9c8f-939af2f9a1b2 req-f4888149-9843-42ac-93b4-0955440b081c service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received unexpected event network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 for instance with vm_state active and task_state rebuilding.
Nov 16 05:35:58 user nova-compute[80928]: DEBUG nova.network.neutron [req-ad456759-80bc-4873-92fc-b831744937f3 req-97fd1a83-ffba-4919-bfaa-e9ae91da654a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updated VIF entry in instance network info cache for port 9211fa0b-0cf5-455a-b696-a6bd23bb2f8b. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:35:58 user nova-compute[80928]: DEBUG nova.network.neutron [req-ad456759-80bc-4873-92fc-b831744937f3 req-97fd1a83-ffba-4919-bfaa-e9ae91da654a service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating instance_info_cache with network_info: [{"id": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "address": "fa:16:3e:5a:19:22", "network": {"id": "f1667eb3-5f9d-4355-9dad-a8703a9ad783", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213234258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9211fa0b-0c", "ovs_interfaceid": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9818988-0285-454f-8f12-52d9203cc9ea", "address": "fa:16:3e:8d:38:fe", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9818988-02", "ovs_interfaceid": "d9818988-0285-454f-8f12-52d9203cc9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "address": "fa:16:3e:fb:ef:67", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664f643e-40", "ovs_interfaceid": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "address": "fa:16:3e:e1:66:8d", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9bc7ae-c5", "ovs_interfaceid": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "address": "fa:16:3e:b1:8b:be", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ed7dc5-8a", "ovs_interfaceid": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "address": "fa:16:3e:90:82:99", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dc6d2a-f0", "ovs_interfaceid": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "address": "fa:16:3e:0e:0b:f3", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26dc4cc-11", "ovs_interfaceid": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:35:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ad456759-80bc-4873-92fc-b831744937f3 req-97fd1a83-ffba-4919-bfaa-e9ae91da654a service nova] Releasing lock "refresh_cache-c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Updating instance_info_cache with network_info: [{"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:35:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:00 user nova-compute[80928]: INFO nova.compute.manager [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Terminating instance
Nov 16 05:36:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-ad0f8e2c-8f93-481b-8fb3-b4187a1f8c6a req-4e332e74-d5d3-47ae-bda6-7a49e1ef1c90 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ad0f8e2c-8f93-481b-8fb3-b4187a1f8c6a req-4e332e74-d5d3-47ae-bda6-7a49e1ef1c90 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ad0f8e2c-8f93-481b-8fb3-b4187a1f8c6a req-4e332e74-d5d3-47ae-bda6-7a49e1ef1c90 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ad0f8e2c-8f93-481b-8fb3-b4187a1f8c6a req-4e332e74-d5d3-47ae-bda6-7a49e1ef1c90 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-ad0f8e2c-8f93-481b-8fb3-b4187a1f8c6a req-4e332e74-d5d3-47ae-bda6-7a49e1ef1c90 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-unplugged-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-ad0f8e2c-8f93-481b-8fb3-b4187a1f8c6a req-4e332e74-d5d3-47ae-bda6-7a49e1ef1c90 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-9ca4d0a5-a417-4af0-bde5-00979326b9f3 req-42da6e62-743e-4981-be45-0da965a5370b service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-d9818988-0285-454f-8f12-52d9203cc9ea {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9ca4d0a5-a417-4af0-bde5-00979326b9f3 req-42da6e62-743e-4981-be45-0da965a5370b service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9ca4d0a5-a417-4af0-bde5-00979326b9f3 req-42da6e62-743e-4981-be45-0da965a5370b service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9ca4d0a5-a417-4af0-bde5-00979326b9f3 req-42da6e62-743e-4981-be45-0da965a5370b service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-9ca4d0a5-a417-4af0-bde5-00979326b9f3 req-42da6e62-743e-4981-be45-0da965a5370b service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-unplugged-d9818988-0285-454f-8f12-52d9203cc9ea {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-9ca4d0a5-a417-4af0-bde5-00979326b9f3 req-42da6e62-743e-4981-be45-0da965a5370b service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-d9818988-0285-454f-8f12-52d9203cc9ea for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:02 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:36:02 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7497MB free_disk=25.51299285888672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:02 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Instance destroyed successfully.
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.objects.instance [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lazy-loading 'resources' on Instance uuid c7409e6d-ea55-41eb-8fab-9fd6a42d21cb {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:34:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "address": "fa:16:3e:5a:19:22", "network": {"id": "f1667eb3-5f9d-4355-9dad-a8703a9ad783", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213234258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9211fa0b-0c", "ovs_interfaceid": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "address": "fa:16:3e:5a:19:22", "network": {"id": "f1667eb3-5f9d-4355-9dad-a8703a9ad783", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213234258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9211fa0b-0c", "ovs_interfaceid": "9211fa0b-0cf5-455a-b696-a6bd23bb2f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:19:22,bridge_name='br-int',has_traffic_filtering=True,id=9211fa0b-0cf5-455a-b696-a6bd23bb2f8b,network=Network(f1667eb3-5f9d-4355-9dad-a8703a9ad783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9211fa0b-0c') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:19:22,bridge_name='br-int',has_traffic_filtering=True,id=9211fa0b-0cf5-455a-b696-a6bd23bb2f8b,network=Network(f1667eb3-5f9d-4355-9dad-a8703a9ad783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9211fa0b-0c') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9211fa0b-0c, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5b28694-6e0d-49a0-a365-c44d528a26cf) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5d03bda0-20b8-497a-a87b-faee21624468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 859f06da-737e-40c3-9e85-2fd33052a9ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance b0211dc5-730f-435b-8d39-3a1606a7696f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance c7409e6d-ea55-41eb-8fab-9fd6a42d21cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 9b3672c1-d287-4caa-b022-aa088d51b97a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: INFO os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:19:22,bridge_name='br-int',has_traffic_filtering=True,id=9211fa0b-0cf5-455a-b696-a6bd23bb2f8b,network=Network(f1667eb3-5f9d-4355-9dad-a8703a9ad783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9211fa0b-0c')
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:34:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9818988-0285-454f-8f12-52d9203cc9ea", "address": "fa:16:3e:8d:38:fe", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9818988-02", "ovs_interfaceid": "d9818988-0285-454f-8f12-52d9203cc9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "d9818988-0285-454f-8f12-52d9203cc9ea", "address": "fa:16:3e:8d:38:fe", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9818988-02", "ovs_interfaceid": "d9818988-0285-454f-8f12-52d9203cc9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:38:fe,bridge_name='br-int',has_traffic_filtering=True,id=d9818988-0285-454f-8f12-52d9203cc9ea,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd9818988-02') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:38:fe,bridge_name='br-int',has_traffic_filtering=True,id=d9818988-0285-454f-8f12-52d9203cc9ea,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd9818988-02') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9818988-02, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:02 user nova-compute[80928]: WARNING nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b for instance with vm_state active and task_state deleting.
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-unplugged-82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-82ed7dc5-8a5c-4283-acdc-1936c1af2011 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:02 user nova-compute[80928]: WARNING nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-82ed7dc5-8a5c-4283-acdc-1936c1af2011 for instance with vm_state active and task_state deleting.
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-unplugged-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:02 user nova-compute[80928]: WARNING nova.compute.manager [req-daf8df10-2a48-4481-8e72-0205e58a4030 req-270bb57c-d7c2-4128-aa09-0c2ee2d2b200 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb for instance with vm_state active and task_state deleting.
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a300979d-4dfc-464a-8f2a-673f83130652) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: INFO os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:38:fe,bridge_name='br-int',has_traffic_filtering=True,id=d9818988-0285-454f-8f12-52d9203cc9ea,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd9818988-02')
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:34:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "address": "fa:16:3e:fb:ef:67", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664f643e-40", "ovs_interfaceid": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "address": "fa:16:3e:fb:ef:67", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664f643e-40", "ovs_interfaceid": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:67,bridge_name='br-int',has_traffic_filtering=True,id=664f643e-408b-4ebe-b6f3-4c8c2dc908de,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap664f643e-40') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:67,bridge_name='br-int',has_traffic_filtering=True,id=664f643e-408b-4ebe-b6f3-4c8c2dc908de,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap664f643e-40') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap664f643e-40, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5b094e6-c397-4c0b-9490-bd8a0952f6d2) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: INFO os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:67,bridge_name='br-int',has_traffic_filtering=True,id=664f643e-408b-4ebe-b6f3-4c8c2dc908de,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap664f643e-40')
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:34:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "address": "fa:16:3e:e1:66:8d", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9bc7ae-c5", "ovs_interfaceid": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "address": "fa:16:3e:e1:66:8d", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9bc7ae-c5", "ovs_interfaceid": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:66:8d,bridge_name='br-int',has_traffic_filtering=True,id=cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9bc7ae-c5') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:66:8d,bridge_name='br-int',has_traffic_filtering=True,id=cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9bc7ae-c5') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc9bc7ae-c5, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13fe5a04-5e90-48b6-b943-0c583a4651b8) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-d9818988-0285-454f-8f12-52d9203cc9ea {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-d9818988-0285-454f-8f12-52d9203cc9ea {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:02 user nova-compute[80928]: WARNING nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-d9818988-0285-454f-8f12-52d9203cc9ea for instance with vm_state active and task_state deleting.
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-664f643e-408b-4ebe-b6f3-4c8c2dc908de {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-unplugged-664f643e-408b-4ebe-b6f3-4c8c2dc908de {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-664f643e-408b-4ebe-b6f3-4c8c2dc908de for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-664f643e-408b-4ebe-b6f3-4c8c2dc908de {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-664f643e-408b-4ebe-b6f3-4c8c2dc908de {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:02 user nova-compute[80928]: WARNING nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-664f643e-408b-4ebe-b6f3-4c8c2dc908de for instance with vm_state active and task_state deleting.
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-unplugged-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:02 user nova-compute[80928]: WARNING nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b for instance with vm_state active and task_state deleting.
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-unplugged-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-75828121-6a60-44c4-a126-41b3394384de req-e958534e-5352-4de4-8580-3e0edff003f2 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-unplugged-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: INFO os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:66:8d,bridge_name='br-int',has_traffic_filtering=True,id=cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9bc7ae-c5')
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:34:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "address": "fa:16:3e:b1:8b:be", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ed7dc5-8a", "ovs_interfaceid": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "address": "fa:16:3e:b1:8b:be", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ed7dc5-8a", "ovs_interfaceid": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=82ed7dc5-8a5c-4283-acdc-1936c1af2011,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ed7dc5-8a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=82ed7dc5-8a5c-4283-acdc-1936c1af2011,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ed7dc5-8a') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82ed7dc5-8a, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97494994-28e0-4dea-a9ab-84be8dda7253) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:02 user nova-compute[80928]: INFO os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=82ed7dc5-8a5c-4283-acdc-1936c1af2011,network=Network(9d96162b-2c91-4842-8524-672c16f28d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ed7dc5-8a')
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:34:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "address": "fa:16:3e:90:82:99", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dc6d2a-f0", "ovs_interfaceid": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "address": "fa:16:3e:90:82:99", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dc6d2a-f0", "ovs_interfaceid": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:82:99,bridge_name='br-int',has_traffic_filtering=True,id=52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dc6d2a-f0') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:82:99,bridge_name='br-int',has_traffic_filtering=True,id=52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dc6d2a-f0') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52dc6d2a-f0, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d890761-0cca-4e39-8271-84a781a22f29) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: INFO os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:82:99,bridge_name='br-int',has_traffic_filtering=True,id=52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dc6d2a-f0')
Nov 16 05:36:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T05:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-351310027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-351310027',id=21,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwAtg8smwkJkqI7aJnz58jwwMY51Kp+T19u40J1+77kjWsOgyuub6nGxq09UOuumabicfMvoWCTKXncjj+iShHVNnnDri5d4SMHY1TVJ403NfPaf6uwz9OLCe0BZCDBA==',key_name='tempest-keypair-932178092',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:34:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0b8244c3134053b614616307802f35',ramdisk_id='',reservation_id='r-wm7l045j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2010731434',owner_user_name='tempest-TaggedBootDevicesTest-2010731434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e814096e334600bcfda87d6fd8cb0b',uuid=c7409e6d-ea55-41eb-8fab-9fd6a42d21cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "address": "fa:16:3e:0e:0b:f3", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26dc4cc-11", "ovs_interfaceid": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converting VIF {"id": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "address": "fa:16:3e:0e:0b:f3", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26dc4cc-11", "ovs_interfaceid": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:0b:f3,bridge_name='br-int',has_traffic_filtering=True,id=c26dc4cc-11a1-42fb-ab32-1b712ed83ecb,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26dc4cc-11') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:0b:f3,bridge_name='br-int',has_traffic_filtering=True,id=c26dc4cc-11a1-42fb-ab32-1b712ed83ecb,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26dc4cc-11') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc26dc4cc-11, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d5f7dfe-778d-484e-a0c1-b84abf8dc977) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: INFO os_vif [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:0b:f3,bridge_name='br-int',has_traffic_filtering=True,id=c26dc4cc-11a1-42fb-ab32-1b712ed83ecb,network=Network(4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26dc4cc-11')
Nov 16 05:36:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfCFabUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:36:03 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[641ffd49-a6b6-437e-9a97-62cd0ca68b91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:36:03 user nova-compute[80928]: No targets found.
Nov 16 05:36:03 user nova-compute[80928]: iSNS:
Nov 16 05:36:03 user nova-compute[80928]: No targets found.
Nov 16 05:36:03 user nova-compute[80928]: STATIC:
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: FIRMWARE:
Nov 16 05:36:03 user nova-compute[80928]: No targets found.
Nov 16 05:36:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:36:03 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:36:03 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[292f3c62-5931-4552-8739-f841c406c81a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8800ea0-8ef9-4558-8abf-ac00650b4130]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a5480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0'): ({'sdf'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Removing single pathed devices sdf {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ea8b1b-df5c-4b02-a626-fa95492d0e90]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5d941e-fd48-4c5d-bd8d-da14a6faeb42]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Flushing IO for device /dev/sdf {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f616cbf-58c1-48b4-9e61-1628fa635398]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a78fbc-5669-4736-b98d-325b9075a32d]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] SCSI volumes sdf have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[caffffca-d9fe-4c4d-8f07-26bf38ed5c7a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa29fc1e-12d1-4713-8ab1-8d8525ed15ef]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0, portal: 172.16.0.220,3260]
Nov 16 05:36:03 user nova-compute[80928]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0, portal: 172.16.0.220,3260] successful.
Nov 16 05:36:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c848a4-ab88-4cd2-a8fc-302d836528b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d610f009-f030-411f-857a-7aabd4394638]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] <== disconnect_volume: return (343ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfdbSRou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:36:03 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec9be11-396f-43b3-90b7-f76df6eb6bf4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:36:03 user nova-compute[80928]: No targets found.
Nov 16 05:36:03 user nova-compute[80928]: iSNS:
Nov 16 05:36:03 user nova-compute[80928]: No targets found.
Nov 16 05:36:03 user nova-compute[80928]: STATIC:
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: FIRMWARE:
Nov 16 05:36:03 user nova-compute[80928]: No targets found.
Nov 16 05:36:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:36:03 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:36:03 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e81c7c-291f-4790-a304-0142352bdead]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[867b1600-eefb-4d8f-8c9c-1f00c729066d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6'): ({'sdg'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Removing single pathed devices sdg {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[491e54a1-3b89-430f-ae42-eb07951f7c2f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8ce7cc-3100-40c2-ad5c-b9ef1224b245]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Flushing IO for device /dev/sdg {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6884de3e-4b3c-4b3e-b38a-6df7f3165e42]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd7d68c-ab61-4a31-9e1f-8d0b318a925f]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] SCSI volumes sdg have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[507acb0f-87f8-46e1-8d5a-22a24d93ff70]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.110s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[73220d38-e231-4ab7-83f9-ad1b66e63eab]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6, portal: 172.16.0.220,3260]
Nov 16 05:36:03 user nova-compute[80928]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6, portal: 172.16.0.220,3260] successful.
Nov 16 05:36:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09dfc924-be3b-4968-b87f-fd18cb353ff6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da0b076-3d09-438e-a6e7-6b3ff5f6f02b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] <== disconnect_volume: return (374ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnBDUzCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:36:03 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[017e6e75-f9cd-47c6-8e1d-aadc5b0a689b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:36:03 user nova-compute[80928]: No targets found.
Nov 16 05:36:03 user nova-compute[80928]: iSNS:
Nov 16 05:36:03 user nova-compute[80928]: No targets found.
Nov 16 05:36:03 user nova-compute[80928]: STATIC:
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:36:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:03 user nova-compute[80928]: FIRMWARE:
Nov 16 05:36:03 user nova-compute[80928]: No targets found.
Nov 16 05:36:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:36:03 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:36:03 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ca53ea-1f36-4ace-8104-0026d75388dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[663ec70c-fce1-4d6c-922c-8a7c12eeefa1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [23] 172.16.0.220:3260,0 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [23] 172.16.0.220:3260,0 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]: tcp: [23] 172.16.0.220:3260,0 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:36:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0'): ({'sdh'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Removing single pathed devices sdh {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[accfaa8f-0ee4-4597-8794-d9e4793bc507]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[943399bf-61dc-4b9b-a3e4-2d14936ee9f4]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Flushing IO for device /dev/sdh {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[453f6934-37ce-434c-9cd3-ff606eaab236]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5318d1-ef14-4f03-816d-bb484e6dda25]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] SCSI volumes sdh have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eae99c2-8bbe-476b-8415-732456584e88]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[502e8707-5573-4a4d-b282-3ea90d70006a]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0, portal: 172.16.0.220,3260]
Nov 16 05:36:04 user nova-compute[80928]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0, portal: 172.16.0.220,3260] successful.
Nov 16 05:36:04 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3151297c-1f63-431d-bc0b-f9f6e45dacd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b18230-a83d-400f-95c3-08f364fa71b0]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] <== disconnect_volume: return (344ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:36:04 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Deleting instance files /opt/stack/data/nova/instances/c7409e6d-ea55-41eb-8fab-9fd6a42d21cb_del
Nov 16 05:36:04 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Deletion of /opt/stack/data/nova/instances/c7409e6d-ea55-41eb-8fab-9fd6a42d21cb_del complete
Nov 16 05:36:04 user nova-compute[80928]: INFO nova.compute.manager [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Took 3.94 seconds to destroy the instance on the hypervisor.
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-3362de69-58d1-4467-83c7-df3bc6d1ed15 req-8d8c9119-5645-419e-9cc7-0102219200f5 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-plugged-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3362de69-58d1-4467-83c7-df3bc6d1ed15 req-8d8c9119-5645-419e-9cc7-0102219200f5 service nova] Acquiring lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3362de69-58d1-4467-83c7-df3bc6d1ed15 req-8d8c9119-5645-419e-9cc7-0102219200f5 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3362de69-58d1-4467-83c7-df3bc6d1ed15 req-8d8c9119-5645-419e-9cc7-0102219200f5 service nova] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-3362de69-58d1-4467-83c7-df3bc6d1ed15 req-8d8c9119-5645-419e-9cc7-0102219200f5 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] No waiting events found dispatching network-vif-plugged-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:04 user nova-compute[80928]: WARNING nova.compute.manager [req-3362de69-58d1-4467-83c7-df3bc6d1ed15 req-8d8c9119-5645-419e-9cc7-0102219200f5 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received unexpected event network-vif-plugged-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 for instance with vm_state active and task_state deleting.
Nov 16 05:36:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-e1bf2958-bee1-4efe-b97f-500c99c8c2d4 req-aa61fc31-530f-4150-ad6e-f39b38ea9729 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-changed-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-e1bf2958-bee1-4efe-b97f-500c99c8c2d4 req-aa61fc31-530f-4150-ad6e-f39b38ea9729 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Refreshing instance network info cache due to event network-changed-04d9eb71-77a9-453e-94e3-b5356df3a824. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e1bf2958-bee1-4efe-b97f-500c99c8c2d4 req-aa61fc31-530f-4150-ad6e-f39b38ea9729 service nova] Acquiring lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e1bf2958-bee1-4efe-b97f-500c99c8c2d4 req-aa61fc31-530f-4150-ad6e-f39b38ea9729 service nova] Acquired lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-e1bf2958-bee1-4efe-b97f-500c99c8c2d4 req-aa61fc31-530f-4150-ad6e-f39b38ea9729 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Refreshing network info cache for port 04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-52c75bec-dd8b-4015-aaf8-d1de78fe7374 req-ff407eb3-8124-48a3-b7d1-37995ac5b190 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-deleted-9211fa0b-0cf5-455a-b696-a6bd23bb2f8b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:06 user nova-compute[80928]: INFO nova.compute.manager [req-52c75bec-dd8b-4015-aaf8-d1de78fe7374 req-ff407eb3-8124-48a3-b7d1-37995ac5b190 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Neutron deleted interface 9211fa0b-0cf5-455a-b696-a6bd23bb2f8b; detaching it from the instance and deleting it from the info cache
Nov 16 05:36:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-52c75bec-dd8b-4015-aaf8-d1de78fe7374 req-ff407eb3-8124-48a3-b7d1-37995ac5b190 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating instance_info_cache with network_info: [{"id": "d9818988-0285-454f-8f12-52d9203cc9ea", "address": "fa:16:3e:8d:38:fe", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9818988-02", "ovs_interfaceid": "d9818988-0285-454f-8f12-52d9203cc9ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "address": "fa:16:3e:fb:ef:67", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664f643e-40", "ovs_interfaceid": "664f643e-408b-4ebe-b6f3-4c8c2dc908de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "address": "fa:16:3e:e1:66:8d", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9bc7ae-c5", "ovs_interfaceid": "cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "address": "fa:16:3e:b1:8b:be", "network": {"id": "9d96162b-2c91-4842-8524-672c16f28d09", "bridge": "br-int", "label": "tempest-device-tagging-net1-2065342227", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ed7dc5-8a", "ovs_interfaceid": "82ed7dc5-8a5c-4283-acdc-1936c1af2011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "address": "fa:16:3e:90:82:99", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dc6d2a-f0", "ovs_interfaceid": "52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "address": "fa:16:3e:0e:0b:f3", "network": {"id": "4704dc7f-6d38-4be1-b9d3-1362a5d3b3bb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1566249477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d0b8244c3134053b614616307802f35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26dc4cc-11", "ovs_interfaceid": "c26dc4cc-11a1-42fb-ab32-1b712ed83ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-52c75bec-dd8b-4015-aaf8-d1de78fe7374 req-ff407eb3-8124-48a3-b7d1-37995ac5b190 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Detach interface failed, port_id=9211fa0b-0cf5-455a-b696-a6bd23bb2f8b, reason: Instance c7409e6d-ea55-41eb-8fab-9fd6a42d21cb could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:06 user nova-compute[80928]: INFO nova.compute.manager [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Terminating instance
Nov 16 05:36:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-e1bf2958-bee1-4efe-b97f-500c99c8c2d4 req-aa61fc31-530f-4150-ad6e-f39b38ea9729 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updated VIF entry in instance network info cache for port 04d9eb71-77a9-453e-94e3-b5356df3a824. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-e1bf2958-bee1-4efe-b97f-500c99c8c2d4 req-aa61fc31-530f-4150-ad6e-f39b38ea9729 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updating instance_info_cache with network_info: [{"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:36:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e1bf2958-bee1-4efe-b97f-500c99c8c2d4 req-aa61fc31-530f-4150-ad6e-f39b38ea9729 service nova] Releasing lock "refresh_cache-30c2bba7-99d9-4eea-8569-bf726c6ba2c8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-dd8659f6-815b-4075-9f79-4b8ef1656ae4 req-f9a0a2ed-e743-4369-a295-b0b415c6f975 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-vif-unplugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dd8659f6-815b-4075-9f79-4b8ef1656ae4 req-f9a0a2ed-e743-4369-a295-b0b415c6f975 service nova] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dd8659f6-815b-4075-9f79-4b8ef1656ae4 req-f9a0a2ed-e743-4369-a295-b0b415c6f975 service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dd8659f6-815b-4075-9f79-4b8ef1656ae4 req-f9a0a2ed-e743-4369-a295-b0b415c6f975 service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-dd8659f6-815b-4075-9f79-4b8ef1656ae4 req-f9a0a2ed-e743-4369-a295-b0b415c6f975 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] No waiting events found dispatching network-vif-unplugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-dd8659f6-815b-4075-9f79-4b8ef1656ae4 req-f9a0a2ed-e743-4369-a295-b0b415c6f975 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-vif-unplugged-04d9eb71-77a9-453e-94e3-b5356df3a824 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:36:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Instance destroyed successfully.
Nov 16 05:36:07 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lazy-loading 'resources' on Instance uuid 30c2bba7-99d9-4eea-8569-bf726c6ba2c8 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1827874150',display_name='tempest-TestShelveInstance-server-1827874150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1827874150',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFWss00Sd4WQc30r+srzERolTutzspIKV/rkvXRQi/zJ8LopBV11TVD70W1JEyEYfSOK795SSzEE4eazoiRudHFx0MWgxud48bCYUdM+qaNBwOKSa4Ki/iqKRGsRldxRg==',key_name='tempest-TestShelveInstance-1824834473',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:34:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bd17a971f5d4b00b634af7f34b14adc',ramdisk_id='',reservation_id='r-cdd685v9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-505947026',owner_user_name='tempest-TestShelveInstance-505947026-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:34:29Z,user_data=None,user_id='7f5ae21217cf4e70864e0331e403a82f',uuid=30c2bba7-99d9-4eea-8569-bf726c6ba2c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Converting VIF {"id": "04d9eb71-77a9-453e-94e3-b5356df3a824", "address": "fa:16:3e:ad:86:90", "network": {"id": "608b76e7-3bb1-4e14-bb50-ba786e11c6c5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2080407201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd17a971f5d4b00b634af7f34b14adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d9eb71-77", "ovs_interfaceid": "04d9eb71-77a9-453e-94e3-b5356df3a824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_vif [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04d9eb71-77, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d772df9-0d01-4237-b3fc-a280777df267) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:07 user nova-compute[80928]: INFO os_vif [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:86:90,bridge_name='br-int',has_traffic_filtering=True,id=04d9eb71-77a9-453e-94e3-b5356df3a824,network=Network(608b76e7-3bb1-4e14-bb50-ba786e11c6c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d9eb71-77')
Nov 16 05:36:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfPUCdIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:36:07 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b5bbef-6c68-4dd8-92e6-353e346fed52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:36:07 user nova-compute[80928]: No targets found.
Nov 16 05:36:07 user nova-compute[80928]: iSNS:
Nov 16 05:36:07 user nova-compute[80928]: No targets found.
Nov 16 05:36:07 user nova-compute[80928]: STATIC:
Nov 16 05:36:07 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:36:07 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:07 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:07 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7
Nov 16 05:36:07 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:07 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:07 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4
Nov 16 05:36:07 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:07 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:07 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:36:07 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:36:07 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:36:07 user nova-compute[80928]: FIRMWARE:
Nov 16 05:36:07 user nova-compute[80928]: No targets found.
Nov 16 05:36:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:36:07 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:36:07 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9050d5ee-dd9b-41ce-a82e-838f0d402013]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3d9f0a-5bb9-472c-b7d4-a6e5b85579df]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:07 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:36:07 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:07 user nova-compute[80928]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:36:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:07 user nova-compute[80928]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 (non-flash)
Nov 16 05:36:07 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:07 user nova-compute[80928]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:36:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a4670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4'): ({'sde'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Removing single pathed devices sde {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4565c5e3-5097-4202-99a1-df41a25eefff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4829455-7bb0-4282-9514-57c2346cc5da]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Flushing IO for device /dev/sde {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7816222-4460-4287-aa21-6cd4d4dbfab5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.069s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b11000-9451-4ea8-8a4e-af17aea39907]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] SCSI volumes sde have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f392c5-195a-46ae-8e6a-7a34025b726e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2e443a-cde8-462f-9d3a-955137ee9b57]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260]
Nov 16 05:36:07 user nova-compute[80928]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4, portal: 172.16.0.220,3260] successful.
Nov 16 05:36:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530422d-5a49-40b4-a9ce-6d67b438dac4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a946c37-d43f-4433-bbd0-ddd329f26861]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] <== disconnect_volume: return (375ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:36:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Deleting instance files /opt/stack/data/nova/instances/30c2bba7-99d9-4eea-8569-bf726c6ba2c8_del
Nov 16 05:36:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Deletion of /opt/stack/data/nova/instances/30c2bba7-99d9-4eea-8569-bf726c6ba2c8_del complete
Nov 16 05:36:07 user nova-compute[80928]: INFO nova.compute.manager [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 16 05:36:07 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:36:07 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:36:07 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Took 3.67 seconds to deallocate network for instance.
Nov 16 05:36:08 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:36:08 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Took 0.47 seconds to deallocate network for instance.
Nov 16 05:36:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-49f8bcd1-7968-4083-90af-a44d81052eed req-199f50cd-624c-4d46-924d-87e47445f30b service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-vif-deleted-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-d1bc4ed0-6be5-48ca-92b3-ff473bd786c5 req-02d0b4a9-dce3-4c4c-9296-2179d9b5ede3 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-deleted-c26dc4cc-11a1-42fb-ab32-1b712ed83ecb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-d1bc4ed0-6be5-48ca-92b3-ff473bd786c5 req-02d0b4a9-dce3-4c4c-9296-2179d9b5ede3 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-deleted-cc9bc7ae-c55b-4883-b5ef-0e7542e40b6b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-d1bc4ed0-6be5-48ca-92b3-ff473bd786c5 req-02d0b4a9-dce3-4c4c-9296-2179d9b5ede3 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-deleted-52dc6d2a-f0cc-4a8e-afe1-91fc75e647e2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-d1bc4ed0-6be5-48ca-92b3-ff473bd786c5 req-02d0b4a9-dce3-4c4c-9296-2179d9b5ede3 service nova] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Received event network-vif-deleted-82ed7dc5-8a5c-4283-acdc-1936c1af2011 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-cff7496f-20e6-422f-af48-460b64cb96e4 req-6960d71b-85e2-4458-896a-f0522e532d81 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received event network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cff7496f-20e6-422f-af48-460b64cb96e4 req-6960d71b-85e2-4458-896a-f0522e532d81 service nova] Acquiring lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cff7496f-20e6-422f-af48-460b64cb96e4 req-6960d71b-85e2-4458-896a-f0522e532d81 service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cff7496f-20e6-422f-af48-460b64cb96e4 req-6960d71b-85e2-4458-896a-f0522e532d81 service nova] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-cff7496f-20e6-422f-af48-460b64cb96e4 req-6960d71b-85e2-4458-896a-f0522e532d81 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] No waiting events found dispatching network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:09 user nova-compute[80928]: WARNING nova.compute.manager [req-cff7496f-20e6-422f-af48-460b64cb96e4 req-6960d71b-85e2-4458-896a-f0522e532d81 service nova] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Received unexpected event network-vif-plugged-04d9eb71-77a9-453e-94e3-b5356df3a824 for instance with vm_state active and task_state deleting.
Nov 16 05:36:09 user nova-compute[80928]: INFO nova.compute.manager [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Took 0.91 seconds to detach 1 volumes for instance.
Nov 16 05:36:09 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] [instance: 30c2bba7-99d9-4eea-8569-bf726c6ba2c8] Deleting volume: f530422d-5a49-40b4-a9ce-6d67b438dac4 {{(pid=80928) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 05:36:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:09 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:36:09 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:36:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:09 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Deleted allocations for instance 30c2bba7-99d9-4eea-8569-bf726c6ba2c8
Nov 16 05:36:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ba19385a-2f40-4b76-a918-0fdecb72c4ad tempest-TestShelveInstance-505947026 tempest-TestShelveInstance-505947026-project-member] Lock "30c2bba7-99d9-4eea-8569-bf726c6ba2c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.308s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:11 user nova-compute[80928]: INFO nova.compute.manager [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] [instance: c7409e6d-ea55-41eb-8fab-9fd6a42d21cb] Took 3.36 seconds to detach 3 volumes for instance.
Nov 16 05:36:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:11 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:36:11 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:36:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:11 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Deleted allocations for instance c7409e6d-ea55-41eb-8fab-9fd6a42d21cb
Nov 16 05:36:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-718e772b-5811-44a4-9d20-ad64f8079d48 tempest-TaggedBootDevicesTest-2010731434 tempest-TaggedBootDevicesTest-2010731434-project-member] Lock "c7409e6d-ea55-41eb-8fab-9fd6a42d21cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.711s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG nova.compute.manager [req-e306dfae-3204-410f-b9d2-749752db332d req-9f1c90a1-1499-4f31-8d38-ca9ec323336c service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event volume-reimaged-35e4c943-129b-442f-89c6-7923123c3ed7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e306dfae-3204-410f-b9d2-749752db332d req-9f1c90a1-1499-4f31-8d38-ca9ec323336c service nova] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e306dfae-3204-410f-b9d2-749752db332d req-9f1c90a1-1499-4f31-8d38-ca9ec323336c service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e306dfae-3204-410f-b9d2-749752db332d req-9f1c90a1-1499-4f31-8d38-ca9ec323336c service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG nova.compute.manager [req-e306dfae-3204-410f-b9d2-749752db332d req-9f1c90a1-1499-4f31-8d38-ca9ec323336c service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Processing event volume-reimaged-35e4c943-129b-442f-89c6-7923123c3ed7 {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:36:12 user nova-compute[80928]: INFO nova.virt.block_device [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Booting with volume 35e4c943-129b-442f-89c6-7923123c3ed7 at /dev/vda
Nov 16 05:36:12 user nova-compute[80928]: DEBUG os_brick.utils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c175fddb-32d7-4a20-9f5f-ee00809eff8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[089507e5-b606-4cc0-99aa-65385a102b23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b382e6-032b-43a2-a021-16ee2367fb94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29e3e72-82f1-4b5a-99d7-b9e247672ab0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:36:12 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:36:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e42b39a-0320-4105-b99f-685b01c15732]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG os_brick.utils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:36:12 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Updating existing volume attachment record: 28905e9d-1614-4056-8cdd-5b3e846024ed {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "c5ae2c42-de68-4619-96a1-643755597b99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:36:15 user nova-compute[80928]: INFO nova.compute.claims [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Claim successful on node user
Nov 16 05:36:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG nova.network.neutron [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:36:15 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:36:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG nova.policy [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f937540a5dd54473ad0858f2776ddf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f752bfba814502898ca7f73eff7e0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:36:15 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Creating image(s)
Nov 16 05:36:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "/opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "/opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.187s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk 1073741824" returned: 0 in 0.066s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Successfully created port: c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Cannot resize image /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Ensure instance console log exists: /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Successfully updated port: c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquired lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-c2a33058-3004-4980-a1f7-d3a9465508fa req-ccf40bd5-b4ec-41e1-b888-b6bb6901cd14 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-changed-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-c2a33058-3004-4980-a1f7-d3a9465508fa req-ccf40bd5-b4ec-41e1-b888-b6bb6901cd14 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Refreshing instance network info cache due to event network-changed-c5104be0-b766-4a44-807e-b82c40dadbd7. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c2a33058-3004-4980-a1f7-d3a9465508fa req-ccf40bd5-b4ec-41e1-b888-b6bb6901cd14 service nova] Acquiring lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:36:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updating instance_info_cache with network_info: [{"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Releasing lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Instance network_info: |[{"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c2a33058-3004-4980-a1f7-d3a9465508fa req-ccf40bd5-b4ec-41e1-b888-b6bb6901cd14 service nova] Acquired lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.network.neutron [req-c2a33058-3004-4980-a1f7-d3a9465508fa req-ccf40bd5-b4ec-41e1-b888-b6bb6901cd14 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Refreshing network info cache for port c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Start _get_guest_xml network_info=[{"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:36:17 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:36:17 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:36:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1482561676',display_name='tempest-ServerStableDeviceRescueTest-server-1482561676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1482561676',id=23,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKM6OfVy/fMoIkNAdBQlGs4YsuhKbjo7U4Pyhuu7nQuz9iHjfG0KiqaWAje4kVGSOOuefUjVyscdxC0DNYuZ5nMnKV1B3Xmel+CsWGIxTUzunTopS8qV71E3xKU2h9HMA==',key_name='tempest-keypair-476297108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6f752bfba814502898ca7f73eff7e0d',ramdisk_id='',reservation_id='r-8q6twa87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-805900344',owner_user_name='tempest-ServerStableDeviceRescueTest-805900344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f937540a5dd54473ad0858f2776ddf66',uuid=c5ae2c42-de68-4619-96a1-643755597b99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Converting VIF {"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:42:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5104be0-b766-4a44-807e-b82c40dadbd7,network=Network(04fdc294-b4a4-4900-9dae-f650571e0829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5104be0-b7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.objects.instance [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lazy-loading 'pci_devices' on Instance uuid c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:36:17 user nova-compute[80928]:   <uuid>c5ae2c42-de68-4619-96a1-643755597b99</uuid>
Nov 16 05:36:17 user nova-compute[80928]:   <name>instance-00000017</name>
Nov 16 05:36:17 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:36:17 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:36:17 user nova-compute[80928]:   <metadata>
Nov 16 05:36:17 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:36:17 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:36:17 user nova-compute[80928]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1482561676</nova:name>
Nov 16 05:36:17 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:36:17</nova:creationTime>
Nov 16 05:36:17 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:36:17 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:36:17 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:36:17 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:36:17 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:36:17 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:36:17 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:36:17 user nova-compute[80928]:       <nova:owner>
Nov 16 05:36:17 user nova-compute[80928]:         <nova:user uuid="f937540a5dd54473ad0858f2776ddf66">tempest-ServerStableDeviceRescueTest-805900344-project-member</nova:user>
Nov 16 05:36:17 user nova-compute[80928]:         <nova:project uuid="d6f752bfba814502898ca7f73eff7e0d">tempest-ServerStableDeviceRescueTest-805900344</nova:project>
Nov 16 05:36:17 user nova-compute[80928]:       </nova:owner>
Nov 16 05:36:17 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:36:17 user nova-compute[80928]:       <nova:ports>
Nov 16 05:36:17 user nova-compute[80928]:         <nova:port uuid="c5104be0-b766-4a44-807e-b82c40dadbd7">
Nov 16 05:36:17 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 05:36:17 user nova-compute[80928]:         </nova:port>
Nov 16 05:36:17 user nova-compute[80928]:       </nova:ports>
Nov 16 05:36:17 user nova-compute[80928]:     </nova:instance>
Nov 16 05:36:17 user nova-compute[80928]:   </metadata>
Nov 16 05:36:17 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:36:17 user nova-compute[80928]:     <system>
Nov 16 05:36:17 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:36:17 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:36:17 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:36:17 user nova-compute[80928]:       <entry name="serial">c5ae2c42-de68-4619-96a1-643755597b99</entry>
Nov 16 05:36:17 user nova-compute[80928]:       <entry name="uuid">c5ae2c42-de68-4619-96a1-643755597b99</entry>
Nov 16 05:36:17 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:36:17 user nova-compute[80928]:     </system>
Nov 16 05:36:17 user nova-compute[80928]:   </sysinfo>
Nov 16 05:36:17 user nova-compute[80928]:   <os>
Nov 16 05:36:17 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:36:17 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:36:17 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:36:17 user nova-compute[80928]:   </os>
Nov 16 05:36:17 user nova-compute[80928]:   <features>
Nov 16 05:36:17 user nova-compute[80928]:     <acpi/>
Nov 16 05:36:17 user nova-compute[80928]:     <apic/>
Nov 16 05:36:17 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:36:17 user nova-compute[80928]:   </features>
Nov 16 05:36:17 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:36:17 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:36:17 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:36:17 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:36:17 user nova-compute[80928]:   </clock>
Nov 16 05:36:17 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:36:17 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:36:17 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:36:17 user nova-compute[80928]:   </cpu>
Nov 16 05:36:17 user nova-compute[80928]:   <devices>
Nov 16 05:36:17 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:36:17 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:36:17 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk"/>
Nov 16 05:36:17 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:36:17 user nova-compute[80928]:     </disk>
Nov 16 05:36:17 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:36:17 user nova-compute[80928]:       <mac address="fa:16:3e:5e:42:ac"/>
Nov 16 05:36:17 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:36:17 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:36:17 user nova-compute[80928]:       <target dev="tapc5104be0-b7"/>
Nov 16 05:36:17 user nova-compute[80928]:     </interface>
Nov 16 05:36:17 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:36:17 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/console.log" append="off"/>
Nov 16 05:36:17 user nova-compute[80928]:     </serial>
Nov 16 05:36:17 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:36:17 user nova-compute[80928]:     <video>
Nov 16 05:36:17 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:36:17 user nova-compute[80928]:     </video>
Nov 16 05:36:17 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:36:17 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:36:17 user nova-compute[80928]:     </rng>
Nov 16 05:36:17 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:36:17 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:36:17 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:36:17 user nova-compute[80928]:     </memballoon>
Nov 16 05:36:17 user nova-compute[80928]:   </devices>
Nov 16 05:36:17 user nova-compute[80928]: </domain>
Nov 16 05:36:17 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:36:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1482561676',display_name='tempest-ServerStableDeviceRescueTest-server-1482561676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1482561676',id=23,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKM6OfVy/fMoIkNAdBQlGs4YsuhKbjo7U4Pyhuu7nQuz9iHjfG0KiqaWAje4kVGSOOuefUjVyscdxC0DNYuZ5nMnKV1B3Xmel+CsWGIxTUzunTopS8qV71E3xKU2h9HMA==',key_name='tempest-keypair-476297108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6f752bfba814502898ca7f73eff7e0d',ramdisk_id='',reservation_id='r-8q6twa87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-805900344',owner_user_name='tempest-ServerStableDeviceRescueTest-805900344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f937540a5dd54473ad0858f2776ddf66',uuid=c5ae2c42-de68-4619-96a1-643755597b99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Converting VIF {"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:42:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5104be0-b766-4a44-807e-b82c40dadbd7,network=Network(04fdc294-b4a4-4900-9dae-f650571e0829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5104be0-b7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_vif [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:42:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5104be0-b766-4a44-807e-b82c40dadbd7,network=Network(04fdc294-b4a4-4900-9dae-f650571e0829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5104be0-b7') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04ea3998-85fa-501e-b987-3ef3cd85bb2b', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5104be0-b7, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5104be0-b7, col_values=(('qos', UUID('c7411c3c-5ce7-4f93-b8af-039180c8502d')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5104be0-b7, col_values=(('external_ids', {'iface-id': 'c5104be0-b766-4a44-807e-b82c40dadbd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:42:ac', 'vm-uuid': 'c5ae2c42-de68-4619-96a1-643755597b99'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:17 user nova-compute[80928]: INFO os_vif [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:42:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5104be0-b766-4a44-807e-b82c40dadbd7,network=Network(04fdc294-b4a4-4900-9dae-f650571e0829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5104be0-b7')
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] No VIF found with MAC fa:16:3e:5e:42:ac, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.network.neutron [req-c2a33058-3004-4980-a1f7-d3a9465508fa req-ccf40bd5-b4ec-41e1-b888-b6bb6901cd14 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updated VIF entry in instance network info cache for port c5104be0-b766-4a44-807e-b82c40dadbd7. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.network.neutron [req-c2a33058-3004-4980-a1f7-d3a9465508fa req-ccf40bd5-b4ec-41e1-b888-b6bb6901cd14 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updating instance_info_cache with network_info: [{"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c2a33058-3004-4980-a1f7-d3a9465508fa req-ccf40bd5-b4ec-41e1-b888-b6bb6901cd14 service nova] Releasing lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:36:17 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Creating image(s)
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Ensure instance console log exists: /opt/stack/data/nova/instances/b0211dc5-730f-435b-8d39-3a1606a7696f/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Start _get_guest_xml network_info=[{"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjFwbycI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0211dc5-730f-435b-8d39-3a1606a7696f', 'attached_at': '', 'detached_at': '', 'volume_id': '35e4c943-129b-442f-89c6-7923123c3ed7', 'serial': '35e4c943-129b-442f-89c6-7923123c3ed7'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '28905e9d-1614-4056-8cdd-5b3e846024ed', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:36:17 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 05:36:17 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lazy-loading 'vcpu_model' on Instance uuid b0211dc5-730f-435b-8d39-3a1606a7696f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjFwbycI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:36:17 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:36:17 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:36:17 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c751d541-6491-4704-95f8-add9ea24182b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:36:17 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[24625a49-3585-4ce8-97e2-873970004aa5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7] added
Nov 16 05:36:17 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[447cac7c-d438-4a87-994a-a7479e63f068]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7485a11f-8746-4199-961d-f7401c7c73c0]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjFwbycI {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjFwbycI" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ee264c-9c5a-4084-9369-3d9b88380c02]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AjFwbycI'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[36394524-c544-4f6b-8b91-748b1b84cbf9]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e4fabc-f0c1-4e92-8a03-a2329a393acb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:17 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:17 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:17 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:17 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d056bbc5-c66d-4a1f-a89d-ad6ae5d442fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260]
Nov 16 05:36:17 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260] successful.
Nov 16 05:36:17 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca58b779-cca0-4dde-bee8-5d369d90ce6d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b0a4bc-e4eb-456d-8e60-0f92e6ae6cc8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:17 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:17 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:36:17 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:17 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:17 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:36:17 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[567703f1-475d-471d-ad5b-378a5dcdd54b]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:36:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjFwbycI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:36:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-f2c8c6b3-3fcf-49ce-8bb0-f2ce355ab5d8 req-93c5ee13-e89f-4613-b3aa-dca5995757d4 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f2c8c6b3-3fcf-49ce-8bb0-f2ce355ab5d8 req-93c5ee13-e89f-4613-b3aa-dca5995757d4 service nova] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f2c8c6b3-3fcf-49ce-8bb0-f2ce355ab5d8 req-93c5ee13-e89f-4613-b3aa-dca5995757d4 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f2c8c6b3-3fcf-49ce-8bb0-f2ce355ab5d8 req-93c5ee13-e89f-4613-b3aa-dca5995757d4 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-f2c8c6b3-3fcf-49ce-8bb0-f2ce355ab5d8 req-93c5ee13-e89f-4613-b3aa-dca5995757d4 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] No waiting events found dispatching network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:18 user nova-compute[80928]: WARNING nova.compute.manager [req-f2c8c6b3-3fcf-49ce-8bb0-f2ce355ab5d8 req-93c5ee13-e89f-4613-b3aa-dca5995757d4 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received unexpected event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 for instance with vm_state building and task_state spawning.
Nov 16 05:36:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:36:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23337643732363432', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:36:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337643732363432', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1081583894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1342069825',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrww7sI55a3Trl1PjEiEIP4wlwDIEoLgs3TLCjEDtdyvuCgUJTQf3YJE0l8HAZq4ews1teuYYbO2FrUVPNoHQVhYuYAl1+w8B/UHR4F7VdE+bpMzQtOmJVEPqskAogcEg==',key_name='tempest-keypair-1036640328',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dde93358753b405293c50a4eb65a55a8',ramdisk_id='',reservation_id='r-bx9ws9wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1532463154',owner_user_name='tempest-ServerActionsV293TestJSON-1532463154-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce09fc1320c4033baf06caf7282676a',uuid=b0211dc5-730f-435b-8d39-3a1606a7696f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Converting VIF {"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:36:19 user nova-compute[80928]:   <uuid>b0211dc5-730f-435b-8d39-3a1606a7696f</uuid>
Nov 16 05:36:19 user nova-compute[80928]:   <name>instance-00000014</name>
Nov 16 05:36:19 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:36:19 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:36:19 user nova-compute[80928]:   <metadata>
Nov 16 05:36:19 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:36:19 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:36:19 user nova-compute[80928]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1081583894</nova:name>
Nov 16 05:36:19 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:36:17</nova:creationTime>
Nov 16 05:36:19 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:36:19 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:36:19 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:36:19 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:36:19 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:36:19 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:36:19 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:36:19 user nova-compute[80928]:       <nova:owner>
Nov 16 05:36:19 user nova-compute[80928]:         <nova:user uuid="7ce09fc1320c4033baf06caf7282676a">tempest-ServerActionsV293TestJSON-1532463154-project-member</nova:user>
Nov 16 05:36:19 user nova-compute[80928]:         <nova:project uuid="dde93358753b405293c50a4eb65a55a8">tempest-ServerActionsV293TestJSON-1532463154</nova:project>
Nov 16 05:36:19 user nova-compute[80928]:       </nova:owner>
Nov 16 05:36:19 user nova-compute[80928]:       <nova:ports>
Nov 16 05:36:19 user nova-compute[80928]:         <nova:port uuid="4acbefc0-9505-48d7-9718-581771fcd450">
Nov 16 05:36:19 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 05:36:19 user nova-compute[80928]:         </nova:port>
Nov 16 05:36:19 user nova-compute[80928]:       </nova:ports>
Nov 16 05:36:19 user nova-compute[80928]:     </nova:instance>
Nov 16 05:36:19 user nova-compute[80928]:   </metadata>
Nov 16 05:36:19 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:36:19 user nova-compute[80928]:     <system>
Nov 16 05:36:19 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:36:19 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:36:19 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:36:19 user nova-compute[80928]:       <entry name="serial">b0211dc5-730f-435b-8d39-3a1606a7696f</entry>
Nov 16 05:36:19 user nova-compute[80928]:       <entry name="uuid">b0211dc5-730f-435b-8d39-3a1606a7696f</entry>
Nov 16 05:36:19 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:36:19 user nova-compute[80928]:     </system>
Nov 16 05:36:19 user nova-compute[80928]:   </sysinfo>
Nov 16 05:36:19 user nova-compute[80928]:   <os>
Nov 16 05:36:19 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:36:19 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:36:19 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:36:19 user nova-compute[80928]:   </os>
Nov 16 05:36:19 user nova-compute[80928]:   <features>
Nov 16 05:36:19 user nova-compute[80928]:     <acpi/>
Nov 16 05:36:19 user nova-compute[80928]:     <apic/>
Nov 16 05:36:19 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:36:19 user nova-compute[80928]:   </features>
Nov 16 05:36:19 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:36:19 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:36:19 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:36:19 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:36:19 user nova-compute[80928]:   </clock>
Nov 16 05:36:19 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:36:19 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:36:19 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:36:19 user nova-compute[80928]:   </cpu>
Nov 16 05:36:19 user nova-compute[80928]:   <devices>
Nov 16 05:36:19 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:36:19 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:36:19 user nova-compute[80928]:       <source dev="/dev/sdc"/>
Nov 16 05:36:19 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:36:19 user nova-compute[80928]:       <serial>35e4c943-129b-442f-89c6-7923123c3ed7</serial>
Nov 16 05:36:19 user nova-compute[80928]:     </disk>
Nov 16 05:36:19 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:36:19 user nova-compute[80928]:       <mac address="fa:16:3e:4b:36:0b"/>
Nov 16 05:36:19 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:36:19 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:36:19 user nova-compute[80928]:       <target dev="tap4acbefc0-95"/>
Nov 16 05:36:19 user nova-compute[80928]:     </interface>
Nov 16 05:36:19 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:36:19 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/b0211dc5-730f-435b-8d39-3a1606a7696f/console.log" append="off"/>
Nov 16 05:36:19 user nova-compute[80928]:     </serial>
Nov 16 05:36:19 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:36:19 user nova-compute[80928]:     <video>
Nov 16 05:36:19 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:36:19 user nova-compute[80928]:     </video>
Nov 16 05:36:19 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:36:19 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:36:19 user nova-compute[80928]:     </rng>
Nov 16 05:36:19 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:36:19 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:36:19 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:36:19 user nova-compute[80928]:     </memballoon>
Nov 16 05:36:19 user nova-compute[80928]:   </devices>
Nov 16 05:36:19 user nova-compute[80928]: </domain>
Nov 16 05:36:19 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1081583894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1342069825',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrww7sI55a3Trl1PjEiEIP4wlwDIEoLgs3TLCjEDtdyvuCgUJTQf3YJE0l8HAZq4ews1teuYYbO2FrUVPNoHQVhYuYAl1+w8B/UHR4F7VdE+bpMzQtOmJVEPqskAogcEg==',key_name='tempest-keypair-1036640328',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dde93358753b405293c50a4eb65a55a8',ramdisk_id='',reservation_id='r-bx9ws9wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1532463154',owner_user_name='tempest-ServerActionsV293TestJSON-1532463154-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce09fc1320c4033baf06caf7282676a',uuid=b0211dc5-730f-435b-8d39-3a1606a7696f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Converting VIF {"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG os_vif [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eaa00514-f615-5c7c-8952-12c862355b07', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4acbefc0-95, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4acbefc0-95, col_values=(('qos', UUID('bda605a1-6f3a-4c55-b94c-62fa33033030')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4acbefc0-95, col_values=(('external_ids', {'iface-id': '4acbefc0-9505-48d7-9718-581771fcd450', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:36:0b', 'vm-uuid': 'b0211dc5-730f-435b-8d39-3a1606a7696f'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:19 user nova-compute[80928]: INFO os_vif [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95')
Nov 16 05:36:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] No VIF found with MAC fa:16:3e:4b:36:0b, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-5a230efe-680a-413f-8391-803c9dda124e req-4eeb4499-380f-4c79-a2b2-a12ec8ef0d27 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5a230efe-680a-413f-8391-803c9dda124e req-4eeb4499-380f-4c79-a2b2-a12ec8ef0d27 service nova] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5a230efe-680a-413f-8391-803c9dda124e req-4eeb4499-380f-4c79-a2b2-a12ec8ef0d27 service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5a230efe-680a-413f-8391-803c9dda124e req-4eeb4499-380f-4c79-a2b2-a12ec8ef0d27 service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-5a230efe-680a-413f-8391-803c9dda124e req-4eeb4499-380f-4c79-a2b2-a12ec8ef0d27 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] No waiting events found dispatching network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:20 user nova-compute[80928]: WARNING nova.compute.manager [req-5a230efe-680a-413f-8391-803c9dda124e req-4eeb4499-380f-4c79-a2b2-a12ec8ef0d27 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received unexpected event network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.compute.manager [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:36:20 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Instance spawned successfully.
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-a100376d-26a2-410f-be34-fe007ee7b918 req-3c9261b0-2d5d-4fa7-87a6-ab3b7f92c263 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a100376d-26a2-410f-be34-fe007ee7b918 req-3c9261b0-2d5d-4fa7-87a6-ab3b7f92c263 service nova] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a100376d-26a2-410f-be34-fe007ee7b918 req-3c9261b0-2d5d-4fa7-87a6-ab3b7f92c263 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a100376d-26a2-410f-be34-fe007ee7b918 req-3c9261b0-2d5d-4fa7-87a6-ab3b7f92c263 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-a100376d-26a2-410f-be34-fe007ee7b918 req-3c9261b0-2d5d-4fa7-87a6-ab3b7f92c263 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] No waiting events found dispatching network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:20 user nova-compute[80928]: WARNING nova.compute.manager [req-a100376d-26a2-410f-be34-fe007ee7b918 req-3c9261b0-2d5d-4fa7-87a6-ab3b7f92c263 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received unexpected event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 for instance with vm_state building and task_state spawning.
Nov 16 05:36:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:20 user nova-compute[80928]: INFO nova.compute.manager [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 16 05:36:20 user nova-compute[80928]: DEBUG nova.compute.manager [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:36:21 user nova-compute[80928]: INFO nova.compute.manager [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Took 5.85 seconds to build instance.
Nov 16 05:36:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-587a3c98-55c9-4e71-b65e-10bc19295ec5 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "c5ae2c42-de68-4619-96a1-643755597b99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.946s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:36:22 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Instance spawned successfully.
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-0c71f9dc-1e66-429f-bd77-05b86344288a req-975f454e-a1a9-4988-babb-fc30c792bbce service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0c71f9dc-1e66-429f-bd77-05b86344288a req-975f454e-a1a9-4988-babb-fc30c792bbce service nova] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0c71f9dc-1e66-429f-bd77-05b86344288a req-975f454e-a1a9-4988-babb-fc30c792bbce service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0c71f9dc-1e66-429f-bd77-05b86344288a req-975f454e-a1a9-4988-babb-fc30c792bbce service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-0c71f9dc-1e66-429f-bd77-05b86344288a req-975f454e-a1a9-4988-babb-fc30c792bbce service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] No waiting events found dispatching network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:22 user nova-compute[80928]: WARNING nova.compute.manager [req-0c71f9dc-1e66-429f-bd77-05b86344288a req-975f454e-a1a9-4988-babb-fc30c792bbce service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received unexpected event network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=80928) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 05:36:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e306dfae-3204-410f-b9d2-749752db332d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "1d95a79b-847f-4eba-a096-65c834f94a40" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:42 user nova-compute[80928]: INFO nova.compute.manager [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Unshelving
Nov 16 05:36:43 user nova-compute[80928]: INFO nova.virt.block_device [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Booting with volume 9379a036-959f-4789-a2e3-723a44580890 at /dev/vdc
Nov 16 05:36:43 user nova-compute[80928]: DEBUG os_brick.utils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ae6e53-b7de-48fd-9ba0-9fa5da8dd6e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4371adb9-ddbf-4ff7-8276-ce059a6aa590]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c381f3a9-4377-4734-960d-363c9c015d56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb8b462-cba4-4090-9c8d-23837c6d190e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:36:43 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:36:43 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f970900a-9cd8-4f01-8e5a-8c8057cfc594]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG os_brick.utils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:36:43 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updating existing volume attachment record: dee3b6e7-a943-4c74-89d2-edfc5c6b81fa {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:36:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:48 user nova-compute[80928]: DEBUG nova.objects.instance [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'pci_requests' on Instance uuid 1d95a79b-847f-4eba-a096-65c834f94a40 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:36:48 user nova-compute[80928]: DEBUG nova.objects.instance [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'numa_topology' on Instance uuid 1d95a79b-847f-4eba-a096-65c834f94a40 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:36:48 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:36:48 user nova-compute[80928]: INFO nova.compute.claims [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Claim successful on node user
Nov 16 05:36:48 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:36:48 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:36:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:48 user nova-compute[80928]: INFO nova.network.neutron [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updating port 3fd63666-004c-416e-877a-dbc4fcbe6fcd with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 05:36:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:36:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquired lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:36:49 user nova-compute[80928]: DEBUG nova.network.neutron [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:36:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-220d164a-9c95-4af8-bddb-32b3bf4cf7d7 req-83ce15bd-6108-4459-aec7-56527b2056cc service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-changed-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-220d164a-9c95-4af8-bddb-32b3bf4cf7d7 req-83ce15bd-6108-4459-aec7-56527b2056cc service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Refreshing instance network info cache due to event network-changed-3fd63666-004c-416e-877a-dbc4fcbe6fcd. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:36:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-220d164a-9c95-4af8-bddb-32b3bf4cf7d7 req-83ce15bd-6108-4459-aec7-56527b2056cc service nova] Acquiring lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:36:50 user nova-compute[80928]: DEBUG nova.network.neutron [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updating instance_info_cache with network_info: [{"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:36:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Releasing lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:36:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:36:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Creating image(s)
Nov 16 05:36:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "/opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "/opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:50 user nova-compute[80928]: DEBUG nova.objects.instance [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1d95a79b-847f-4eba-a096-65c834f94a40 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:36:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-220d164a-9c95-4af8-bddb-32b3bf4cf7d7 req-83ce15bd-6108-4459-aec7-56527b2056cc service nova] Acquired lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:36:50 user nova-compute[80928]: DEBUG nova.network.neutron [req-220d164a-9c95-4af8-bddb-32b3bf4cf7d7 req-83ce15bd-6108-4459-aec7-56527b2056cc service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Refreshing network info cache for port 3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:36:50 user nova-compute[80928]: DEBUG nova.objects.base [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Object Instance<1d95a79b-847f-4eba-a096-65c834f94a40> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:36:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "faea101239a75d8c49e71e85647c69deacb699a6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "faea101239a75d8c49e71e85647c69deacb699a6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6.part --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6.part --force-share --output=json" returned: 0 in 0.267s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:51 user nova-compute[80928]: DEBUG nova.virt.images [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] 428ac015-a9d2-45a0-b464-01202500d216 was qcow2, converting to raw {{(pid=80928) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 05:36:51 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:36:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6.part /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6.converted {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:51 user nova-compute[80928]: DEBUG nova.network.neutron [req-220d164a-9c95-4af8-bddb-32b3bf4cf7d7 req-83ce15bd-6108-4459-aec7-56527b2056cc service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updated VIF entry in instance network info cache for port 3fd63666-004c-416e-877a-dbc4fcbe6fcd. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:36:51 user nova-compute[80928]: DEBUG nova.network.neutron [req-220d164a-9c95-4af8-bddb-32b3bf4cf7d7 req-83ce15bd-6108-4459-aec7-56527b2056cc service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updating instance_info_cache with network_info: [{"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:36:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-220d164a-9c95-4af8-bddb-32b3bf4cf7d7 req-83ce15bd-6108-4459-aec7-56527b2056cc service nova] Releasing lock "refresh_cache-1d95a79b-847f-4eba-a096-65c834f94a40" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:36:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6.part /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6.converted" returned: 0 in 0.225s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6.converted --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "faea101239a75d8c49e71e85647c69deacb699a6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.697s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6 --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "faea101239a75d8c49e71e85647c69deacb699a6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "faea101239a75d8c49e71e85647c69deacb699a6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6 --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6,backing_fmt=raw /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6,backing_fmt=raw /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk 1073741824" returned: 0 in 0.047s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "faea101239a75d8c49e71e85647c69deacb699a6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6 --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG nova.objects.instance [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'migration_context' on Instance uuid 1d95a79b-847f-4eba-a096-65c834f94a40 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG nova.objects.base [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Object Instance<1d95a79b-847f-4eba-a096-65c834f94a40> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:36:52 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Rebasing disk image.
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 -F raw /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:36:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 -F raw /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk" returned: 0 in 2.348s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Ensure instance console log exists: /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Start _get_guest_xml network_info=[{"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='0dc0d67e5544b6fb04e6a215cf4f9bba',container_format='bare',created_at=2023-11-16T05:34:50Z,direct_url=<?>,disk_format='qcow2',id=428ac015-a9d2-45a0-b464-01202500d216,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-829617757-shelved',owner='9efdd13a65f44182a910ecf45bf27116',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T05:34:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SefUPDoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '1d95a79b-847f-4eba-a096-65c834f94a40', 'attached_at': '', 'detached_at': '', 'volume_id': '9379a036-959f-4789-a2e3-723a44580890', 'serial': '9379a036-959f-4789-a2e3-723a44580890'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'dee3b6e7-a943-4c74-89d2-edfc5c6b81fa', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:36:55 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:36:55 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0dc0d67e5544b6fb04e6a215cf4f9bba',container_format='bare',created_at=2023-11-16T05:34:50Z,direct_url=<?>,disk_format='qcow2',id=428ac015-a9d2-45a0-b464-01202500d216,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-829617757-shelved',owner='9efdd13a65f44182a910ecf45bf27116',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T05:34:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d95a79b-847f-4eba-a096-65c834f94a40 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.objects.base [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Object Instance<1d95a79b-847f-4eba-a096-65c834f94a40> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SefUPDoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:36:55 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:36:55 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:36:55 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260" returned: 21 in 0.041s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0684a266-9c18-4dcb-81a4-b8461939e141]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:36:55 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bb7032-42dc-47af-bf34-49345e1fbbf7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890] added
Nov 16 05:36:55 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.051s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dad215-507b-4553-8f18-ddef342ed73a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cd3a84-927d-4e68-b707-1561a701b15a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SefUPDoK {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SefUPDoK" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aceb9e-1cae-4304-9c0a-7e352fd5f619]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SefUPDoK'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cf2aac-c37a-45c6-b010-9f12e63d7de1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[debf7048-1853-4473-9052-624c64437c5c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2478b0b2-9d49-4c90-a3ba-1495859b7fa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890, portal: 172.16.0.220,3260]
Nov 16 05:36:55 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890, portal: 172.16.0.220,3260] successful.
Nov 16 05:36:55 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdd5907-5d12-436e-9f8a-64e4260ca212]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed16f202-ae28-471c-8142-25a0e260f0ed]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:36:55 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4d2415-8c4b-43e1-8a43-698eb5145403]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:36:55 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SefUPDoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23231313162373232', 'path': '/dev/sde'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231313162373232', 'path': '/dev/sde'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-829617757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-829617757',id=18,image_ref='428ac015-a9d2-45a0-b464-01202500d216',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1667699851',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:33:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9efdd13a65f44182a910ecf45bf27116',ramdisk_id='',reservation_id='r-y0372kuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-658694431',owner_user_name='tempest-AttachVolumeShelveTestJSON-658694431-project-member',shelved_at='2023-11-16T05:34:54.685398',shelved_host='user',shelved_image_id='428ac015-a9d2-45a0-b464-01202500d216'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:36:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='505358920a9e43c59cf29b85ffbccb95',uuid=1d95a79b-847f-4eba-a096-65c834f94a40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converting VIF {"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.objects.instance [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d95a79b-847f-4eba-a096-65c834f94a40 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.objects.base [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Object Instance<1d95a79b-847f-4eba-a096-65c834f94a40> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:36:56 user nova-compute[80928]:   <uuid>1d95a79b-847f-4eba-a096-65c834f94a40</uuid>
Nov 16 05:36:56 user nova-compute[80928]:   <name>instance-00000012</name>
Nov 16 05:36:56 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:36:56 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:36:56 user nova-compute[80928]:   <metadata>
Nov 16 05:36:56 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:36:56 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:36:56 user nova-compute[80928]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-829617757</nova:name>
Nov 16 05:36:56 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:36:55</nova:creationTime>
Nov 16 05:36:56 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:36:56 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:36:56 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:36:56 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:36:56 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:36:56 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:36:56 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:36:56 user nova-compute[80928]:       <nova:owner>
Nov 16 05:36:56 user nova-compute[80928]:         <nova:user uuid="505358920a9e43c59cf29b85ffbccb95">tempest-AttachVolumeShelveTestJSON-658694431-project-member</nova:user>
Nov 16 05:36:56 user nova-compute[80928]:         <nova:project uuid="9efdd13a65f44182a910ecf45bf27116">tempest-AttachVolumeShelveTestJSON-658694431</nova:project>
Nov 16 05:36:56 user nova-compute[80928]:       </nova:owner>
Nov 16 05:36:56 user nova-compute[80928]:       <nova:root type="image" uuid="428ac015-a9d2-45a0-b464-01202500d216"/>
Nov 16 05:36:56 user nova-compute[80928]:       <nova:ports>
Nov 16 05:36:56 user nova-compute[80928]:         <nova:port uuid="3fd63666-004c-416e-877a-dbc4fcbe6fcd">
Nov 16 05:36:56 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:36:56 user nova-compute[80928]:         </nova:port>
Nov 16 05:36:56 user nova-compute[80928]:       </nova:ports>
Nov 16 05:36:56 user nova-compute[80928]:     </nova:instance>
Nov 16 05:36:56 user nova-compute[80928]:   </metadata>
Nov 16 05:36:56 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:36:56 user nova-compute[80928]:     <system>
Nov 16 05:36:56 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:36:56 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:36:56 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:36:56 user nova-compute[80928]:       <entry name="serial">1d95a79b-847f-4eba-a096-65c834f94a40</entry>
Nov 16 05:36:56 user nova-compute[80928]:       <entry name="uuid">1d95a79b-847f-4eba-a096-65c834f94a40</entry>
Nov 16 05:36:56 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:36:56 user nova-compute[80928]:     </system>
Nov 16 05:36:56 user nova-compute[80928]:   </sysinfo>
Nov 16 05:36:56 user nova-compute[80928]:   <os>
Nov 16 05:36:56 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:36:56 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:36:56 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:36:56 user nova-compute[80928]:   </os>
Nov 16 05:36:56 user nova-compute[80928]:   <features>
Nov 16 05:36:56 user nova-compute[80928]:     <acpi/>
Nov 16 05:36:56 user nova-compute[80928]:     <apic/>
Nov 16 05:36:56 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:36:56 user nova-compute[80928]:   </features>
Nov 16 05:36:56 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:36:56 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:36:56 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:36:56 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:36:56 user nova-compute[80928]:   </clock>
Nov 16 05:36:56 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:36:56 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:36:56 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:36:56 user nova-compute[80928]:   </cpu>
Nov 16 05:36:56 user nova-compute[80928]:   <devices>
Nov 16 05:36:56 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:36:56 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:36:56 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk"/>
Nov 16 05:36:56 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:36:56 user nova-compute[80928]:     </disk>
Nov 16 05:36:56 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:36:56 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:36:56 user nova-compute[80928]:       <source dev="/dev/sde"/>
Nov 16 05:36:56 user nova-compute[80928]:       <target dev="vdc" bus="virtio"/>
Nov 16 05:36:56 user nova-compute[80928]:       <serial>9379a036-959f-4789-a2e3-723a44580890</serial>
Nov 16 05:36:56 user nova-compute[80928]:     </disk>
Nov 16 05:36:56 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:36:56 user nova-compute[80928]:       <mac address="fa:16:3e:cb:36:8f"/>
Nov 16 05:36:56 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:36:56 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:36:56 user nova-compute[80928]:       <target dev="tap3fd63666-00"/>
Nov 16 05:36:56 user nova-compute[80928]:     </interface>
Nov 16 05:36:56 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:36:56 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/console.log" append="off"/>
Nov 16 05:36:56 user nova-compute[80928]:     </serial>
Nov 16 05:36:56 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:36:56 user nova-compute[80928]:     <video>
Nov 16 05:36:56 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:36:56 user nova-compute[80928]:     </video>
Nov 16 05:36:56 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:36:56 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:36:56 user nova-compute[80928]:     </rng>
Nov 16 05:36:56 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:36:56 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:36:56 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:36:56 user nova-compute[80928]:     </memballoon>
Nov 16 05:36:56 user nova-compute[80928]:   </devices>
Nov 16 05:36:56 user nova-compute[80928]: </domain>
Nov 16 05:36:56 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-829617757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-829617757',id=18,image_ref='428ac015-a9d2-45a0-b464-01202500d216',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1667699851',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:33:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9efdd13a65f44182a910ecf45bf27116',ramdisk_id='',reservation_id='r-y0372kuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-658694431',owner_user_name='tempest-AttachVolumeShelveTestJSON-658694431-project-member',shelved_at='2023-11-16T05:34:54.685398',shelved_host='user',shelved_image_id='428ac015-a9d2-45a0-b464-01202500d216'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:36:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='505358920a9e43c59cf29b85ffbccb95',uuid=1d95a79b-847f-4eba-a096-65c834f94a40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converting VIF {"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG os_vif [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcebc1d3-4c78-5449-9409-8260166fd7a1', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fd63666-00, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fd63666-00, col_values=(('qos', UUID('6a004e99-618e-485a-9cde-da2fada72066')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fd63666-00, col_values=(('external_ids', {'iface-id': '3fd63666-004c-416e-877a-dbc4fcbe6fcd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:36:8f', 'vm-uuid': '1d95a79b-847f-4eba-a096-65c834f94a40'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:56 user nova-compute[80928]: INFO os_vif [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00')
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] No BDM found with device name vdc, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:36:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] No VIF found with MAC fa:16:3e:cb:36:8f, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:36:57 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:36:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-02fa1cd7-3463-4228-94a7-aad67fd73950 req-5c969bf8-c488-42c8-adf8-950c9b459724 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:36:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-02fa1cd7-3463-4228-94a7-aad67fd73950 req-5c969bf8-c488-42c8-adf8-950c9b459724 service nova] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:36:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-02fa1cd7-3463-4228-94a7-aad67fd73950 req-5c969bf8-c488-42c8-adf8-950c9b459724 service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:36:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-02fa1cd7-3463-4228-94a7-aad67fd73950 req-5c969bf8-c488-42c8-adf8-950c9b459724 service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:36:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-02fa1cd7-3463-4228-94a7-aad67fd73950 req-5c969bf8-c488-42c8-adf8-950c9b459724 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] No waiting events found dispatching network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:36:58 user nova-compute[80928]: WARNING nova.compute.manager [req-02fa1cd7-3463-4228-94a7-aad67fd73950 req-5c969bf8-c488-42c8-adf8-950c9b459724 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received unexpected event network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 05:36:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:36:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:36:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-5d03bda0-20b8-497a-a87b-faee21624468" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:36:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-5d03bda0-20b8-497a-a87b-faee21624468" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:36:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:36:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:36:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Updating instance_info_cache with network_info: [{"id": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "address": "fa:16:3e:57:d0:dd", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af67efa-d1", "ovs_interfaceid": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-5d03bda0-20b8-497a-a87b-faee21624468" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-1e5c7820-65e3-4451-8017-569d64c5bda8 req-c3c1565d-cbb5-4123-b08e-8d53512f822f service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1e5c7820-65e3-4451-8017-569d64c5bda8 req-c3c1565d-cbb5-4123-b08e-8d53512f822f service nova] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1e5c7820-65e3-4451-8017-569d64c5bda8 req-c3c1565d-cbb5-4123-b08e-8d53512f822f service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1e5c7820-65e3-4451-8017-569d64c5bda8 req-c3c1565d-cbb5-4123-b08e-8d53512f822f service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-1e5c7820-65e3-4451-8017-569d64c5bda8 req-c3c1565d-cbb5-4123-b08e-8d53512f822f service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] No waiting events found dispatching network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:00 user nova-compute[80928]: WARNING nova.compute.manager [req-1e5c7820-65e3-4451-8017-569d64c5bda8 req-c3c1565d-cbb5-4123-b08e-8d53512f822f service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received unexpected event network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json" returned: 0 in 0.346s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG nova.objects.instance [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lazy-loading 'flavor' on Instance uuid 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:37:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:37:00 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Instance spawned successfully.
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:01 user nova-compute[80928]: INFO nova.compute.manager [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Attaching volume 04b116c5-edf0-4afd-b73c-74bef2ce3b13 to /dev/vdb
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG os_brick.utils [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[437cac17-05e6-4877-ac7b-b8cebb328d66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[244a1237-a67c-43a9-9392-fe54b20d94dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6ea052-f801-432d-b476-053585329d5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8888d4d7-8599-4772-ba83-1f14d2bbb9ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:37:01 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6d3f7e-0bfd-4d8a-accb-17b5a8f99b37]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG os_brick.utils [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating existing volume attachment record: 06e0981e-bb69-4bf7-b8ef-13d303aa2113 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-db14073c-1197-4225-929e-cc9a51227599 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "1d95a79b-847f-4eba-a096-65c834f94a40" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.622s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:37:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:04 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:37:04 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7570MB free_disk=25.33826446533203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5d03bda0-20b8-497a-a87b-faee21624468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 859f06da-737e-40c3-9e85-2fd33052a9ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance b0211dc5-730f-435b-8d39-3a1606a7696f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 9b3672c1-d287-4caa-b022-aa088d51b97a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance c5ae2c42-de68-4619-96a1-643755597b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 1d95a79b-847f-4eba-a096-65c834f94a40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:37:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:37:05 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:37:05 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:37:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:37:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:37:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:37:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:37:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:37:05 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:37:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNroILOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:37:07 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:37:07 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:37:07 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bb6bc6-56a8-4af2-b327-f25f7d204fdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:37:07 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[544fa299-445e-4af6-b90f-849f354d1280]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13] added
Nov 16 05:37:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[67321aec-bc11-437a-b1d0-624d2a808344]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd140244-3ba3-42cc-8b2a-fec8b51aa5dd]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNroILOF {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNroILOF" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2780dc-c7e6-4bf4-8b09-81d7aace542b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vNroILOF'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[807b643a-9cbe-45a2-85ff-ea08f66df039]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[589f5226-04ce-4e46-8250-2ed06d0d4cad]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0710f1e8-6a44-4b39-9ca6-0bc1fb4fb0a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260]
Nov 16 05:37:07 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260] successful.
Nov 16 05:37:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.122s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[283aa1db-93d6-4009-aa1c-efe34fa86889]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[35816f5c-ed39-40a8-94e8-755935df1588]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:37:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d346fa4e-3943-4609-ac62-d13324665270]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:37:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNroILOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:37:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:37:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23139393564656463', 'path': '/dev/sdf'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:37:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139393564656463', 'path': '/dev/sdf'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:37:08 user nova-compute[80928]: DEBUG nova.objects.instance [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lazy-loading 'flavor' on Instance uuid 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:37:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:37:08 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:37:08 user nova-compute[80928]:   <source dev="/dev/sdf"/>
Nov 16 05:37:08 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:37:08 user nova-compute[80928]:   <serial>04b116c5-edf0-4afd-b73c-74bef2ce3b13</serial>
Nov 16 05:37:08 user nova-compute[80928]: </disk>
Nov 16 05:37:08 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:37:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:37:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:37:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] No VIF found with MAC fa:16:3e:58:5c:e5, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:37:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9ec553cc-620d-4a76-b615-3ec8c7e57989 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.045s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:11 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Stashing vm_state: active {{(pid=80928) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 05:37:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:12 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:37:12 user nova-compute[80928]: INFO nova.compute.claims [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Claim successful on node user
Nov 16 05:37:12 user nova-compute[80928]: INFO nova.compute.resource_tracker [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating resource usage from migration 7d993896-ad98-4861-aac2-d9e3321576f7
Nov 16 05:37:12 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:37:12 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:37:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.540s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:12 user nova-compute[80928]: INFO nova.compute.manager [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Migrating
Nov 16 05:37:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:37:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquired lock "compute-rpcapi-router" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:37:12 user nova-compute[80928]: INFO nova.compute.rpcapi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 16 05:37:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Releasing lock "compute-rpcapi-router" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:37:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquired lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:37:12 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:37:13 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating instance_info_cache with network_info: [{"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Releasing lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Starting migrate_disk_and_power_off {{(pid=80928) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 05:37:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-e8de3239-91fb-41c8-860b-a72bd15a4c83 req-20ef1479-0707-4a48-91c2-7e4ac9eb28f9 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-unplugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e8de3239-91fb-41c8-860b-a72bd15a4c83 req-20ef1479-0707-4a48-91c2-7e4ac9eb28f9 service nova] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e8de3239-91fb-41c8-860b-a72bd15a4c83 req-20ef1479-0707-4a48-91c2-7e4ac9eb28f9 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e8de3239-91fb-41c8-860b-a72bd15a4c83 req-20ef1479-0707-4a48-91c2-7e4ac9eb28f9 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-e8de3239-91fb-41c8-860b-a72bd15a4c83 req-20ef1479-0707-4a48-91c2-7e4ac9eb28f9 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] No waiting events found dispatching network-vif-unplugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:13 user nova-compute[80928]: WARNING nova.compute.manager [req-e8de3239-91fb-41c8-860b-a72bd15a4c83 req-20ef1479-0707-4a48-91c2-7e4ac9eb28f9 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received unexpected event network-vif-unplugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 for instance with vm_state active and task_state resize_migrating.
Nov 16 05:37:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Instance destroyed successfully.
Nov 16 05:37:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:33:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1720886813',display_name='tempest-ServerActionsTestOtherB-server-1720886813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1720886813',id=19,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9liT9/8OcIK+JyCDfTMk3trFPyZpf/7B0mBbUikRHMSTPB1lcjCLvTtHnBj5VmxOBF7smgL7oBOajybgsCgVmXQlH849r5LdVXz3wtlHkH2OG/ZZJDnudNBjLF68+HYQ==',key_name='tempest-keypair-454342651',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:33:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1a8884142201406a89f46fdfcfb7cb7e',ramdisk_id='',reservation_id='r-0aqy2onj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1064773206',owner_user_name='tempest-ServerActionsTestOtherB-1064773206-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea9806dcc82048899583dd9f738c109d',uuid=431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1526085965-network", "vif_mac": "fa:16:3e:58:5c:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converting VIF {"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1526085965-network", "vif_mac": "fa:16:3e:58:5c:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_vif [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42b5d66c-7f, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8448483a-8ebe-4799-8e45-7d55ae773ab5) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:14 user nova-compute[80928]: INFO os_vif [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f')
Nov 16 05:37:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNroILOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:37:14 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f59b928-fd93-4b7b-b1f5-edcc02bb2e42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:37:14 user nova-compute[80928]: No targets found.
Nov 16 05:37:14 user nova-compute[80928]: iSNS:
Nov 16 05:37:14 user nova-compute[80928]: No targets found.
Nov 16 05:37:14 user nova-compute[80928]: STATIC:
Nov 16 05:37:14 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:37:14 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:37:14 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:37:14 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13
Nov 16 05:37:14 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:37:14 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:37:14 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890
Nov 16 05:37:14 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:37:14 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:37:14 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7
Nov 16 05:37:14 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:37:14 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:37:14 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:37:14 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:37:14 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:37:14 user nova-compute[80928]: FIRMWARE:
Nov 16 05:37:14 user nova-compute[80928]: No targets found.
Nov 16 05:37:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:37:14 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:37:14 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1914e03-5eb1-4cba-bd0e-d0850d869652]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "3255dd8b-2060-470f-a4bb-08594977342e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "3255dd8b-2060-470f-a4bb-08594977342e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8fe6ee-fa60-45f9-9a24-5cead93b335c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:14 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:14 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:14 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:14 user nova-compute[80928]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:37:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:14 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:14 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:14 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:14 user nova-compute[80928]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:37:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f865843b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13'): ({'sdf'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Removing single pathed devices sdf {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23738da-c30c-44cc-9542-808bdac9410d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fd2d8b-ee75-4ffe-8dab-f1de4cea65b3]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Flushing IO for device /dev/sdf {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b280a44-25ef-42ff-8699-fe603ff1f5f7]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:37:14 user nova-compute[80928]: INFO nova.compute.claims [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Claim successful on node user
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf560c1-4577-4998-89de-3fbfc63c6b21]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] SCSI volumes sdf have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f489ef-3731-4379-8bcb-2144316cfd30]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afd64c5-07cb-4603-a918-d7dc5facf6e4]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260]
Nov 16 05:37:14 user nova-compute[80928]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260] successful.
Nov 16 05:37:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6b4782-4573-4979-bd5c-70d7f9c8bd72]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] <== disconnect_volume: return (365ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:37:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc_resize/disk /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:37:15 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:37:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG nova.policy [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b59ee86b35a24e9680ce12033601b282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699d28ce9a62462b909d1bb5dc801a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:37:15 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Creating image(s)
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "/opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "/opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "/opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CMD "cp -r /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc_resize/disk /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk" returned: 0 in 0.439s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc_resize/disk.info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk.info {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CMD "cp -r /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc_resize/disk.info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk.info" returned: 0 in 0.040s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.202s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-c139eaeb-20c8-42c7-9436-b9d8e588c734 req-e0ef8afb-3f35-4e9e-9952-465c6da65f7f service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c139eaeb-20c8-42c7-9436-b9d8e588c734 req-e0ef8afb-3f35-4e9e-9952-465c6da65f7f service nova] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c139eaeb-20c8-42c7-9436-b9d8e588c734 req-e0ef8afb-3f35-4e9e-9952-465c6da65f7f service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c139eaeb-20c8-42c7-9436-b9d8e588c734 req-e0ef8afb-3f35-4e9e-9952-465c6da65f7f service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-c139eaeb-20c8-42c7-9436-b9d8e588c734 req-e0ef8afb-3f35-4e9e-9952-465c6da65f7f service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] No waiting events found dispatching network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:16 user nova-compute[80928]: WARNING nova.compute.manager [req-c139eaeb-20c8-42c7-9436-b9d8e588c734 req-e0ef8afb-3f35-4e9e-9952-465c6da65f7f service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received unexpected event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 for instance with vm_state active and task_state resize_migrating.
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk 1073741824" returned: 0 in 0.058s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Cannot resize image /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Ensure instance console log exists: /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Successfully created port: 344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Port 42b5d66c-7f70-41b3-b29c-58333c62c7f2 binding to destination host user is already ACTIVE {{(pid=80928) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:37:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquired lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:37:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:37:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Successfully updated port: 344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:37:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "refresh_cache-3255dd8b-2060-470f-a4bb-08594977342e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:37:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquired lock "refresh_cache-3255dd8b-2060-470f-a4bb-08594977342e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:37:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:37:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Updating instance_info_cache with network_info: [{"id": "344ee51b-d7e6-4813-97b2-7434273589c3", "address": "fa:16:3e:81:8c:4a", "network": {"id": "07881f2c-0956-470f-89b1-166df36eee1d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-540690920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "699d28ce9a62462b909d1bb5dc801a0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344ee51b-d7", "ovs_interfaceid": "344ee51b-d7e6-4813-97b2-7434273589c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating instance_info_cache with network_info: [{"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Releasing lock "refresh_cache-3255dd8b-2060-470f-a4bb-08594977342e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Instance network_info: |[{"id": "344ee51b-d7e6-4813-97b2-7434273589c3", "address": "fa:16:3e:81:8c:4a", "network": {"id": "07881f2c-0956-470f-89b1-166df36eee1d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-540690920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "699d28ce9a62462b909d1bb5dc801a0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344ee51b-d7", "ovs_interfaceid": "344ee51b-d7e6-4813-97b2-7434273589c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Start _get_guest_xml network_info=[{"id": "344ee51b-d7e6-4813-97b2-7434273589c3", "address": "fa:16:3e:81:8c:4a", "network": {"id": "07881f2c-0956-470f-89b1-166df36eee1d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-540690920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "699d28ce9a62462b909d1bb5dc801a0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344ee51b-d7", "ovs_interfaceid": "344ee51b-d7e6-4813-97b2-7434273589c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-6c96199d-6a34-4879-9ae3-67870d431ce4 req-cfc4b7ea-9b28-4d3f-b7ba-99c9fc8bd197 service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Received event network-changed-344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-6c96199d-6a34-4879-9ae3-67870d431ce4 req-cfc4b7ea-9b28-4d3f-b7ba-99c9fc8bd197 service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Refreshing instance network info cache due to event network-changed-344ee51b-d7e6-4813-97b2-7434273589c3. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6c96199d-6a34-4879-9ae3-67870d431ce4 req-cfc4b7ea-9b28-4d3f-b7ba-99c9fc8bd197 service nova] Acquiring lock "refresh_cache-3255dd8b-2060-470f-a4bb-08594977342e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6c96199d-6a34-4879-9ae3-67870d431ce4 req-cfc4b7ea-9b28-4d3f-b7ba-99c9fc8bd197 service nova] Acquired lock "refresh_cache-3255dd8b-2060-470f-a4bb-08594977342e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.network.neutron [req-6c96199d-6a34-4879-9ae3-67870d431ce4 req-cfc4b7ea-9b28-4d3f-b7ba-99c9fc8bd197 service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Refreshing network info cache for port 344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Releasing lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:18 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:37:18 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-578981665',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-578981665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5789816',id=24,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOpNxyZjC0M+TQHg+dvDC96vNDu0Jkf3PCKWAR8HSJ0LMcmPrjGcQrnW8lHJ9iJ958vYeYvWp8dZScTOUUxJpUcdTP/CPLSQ2PFk9DUkkt3o7J5eF00d0503JguQppNeA==',key_name='tempest-keypair-1961297760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='699d28ce9a62462b909d1bb5dc801a0f',ramdisk_id='',reservation_id='r-3rfohzf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-879383734',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b59ee86b35a24e9680ce12033601b282',uuid=3255dd8b-2060-470f-a4bb-08594977342e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "344ee51b-d7e6-4813-97b2-7434273589c3", "address": "fa:16:3e:81:8c:4a", "network": {"id": "07881f2c-0956-470f-89b1-166df36eee1d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-540690920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "699d28ce9a62462b909d1bb5dc801a0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344ee51b-d7", "ovs_interfaceid": "344ee51b-d7e6-4813-97b2-7434273589c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Converting VIF {"id": "344ee51b-d7e6-4813-97b2-7434273589c3", "address": "fa:16:3e:81:8c:4a", "network": {"id": "07881f2c-0956-470f-89b1-166df36eee1d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-540690920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "699d28ce9a62462b909d1bb5dc801a0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344ee51b-d7", "ovs_interfaceid": "344ee51b-d7e6-4813-97b2-7434273589c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:8c:4a,bridge_name='br-int',has_traffic_filtering=True,id=344ee51b-d7e6-4813-97b2-7434273589c3,network=Network(07881f2c-0956-470f-89b1-166df36eee1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344ee51b-d7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.objects.instance [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lazy-loading 'pci_devices' on Instance uuid 3255dd8b-2060-470f-a4bb-08594977342e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:37:18 user nova-compute[80928]:   <uuid>3255dd8b-2060-470f-a4bb-08594977342e</uuid>
Nov 16 05:37:18 user nova-compute[80928]:   <name>instance-00000018</name>
Nov 16 05:37:18 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:37:18 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:37:18 user nova-compute[80928]:   <metadata>
Nov 16 05:37:18 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:37:18 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:37:18 user nova-compute[80928]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-578981665</nova:name>
Nov 16 05:37:18 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:37:18</nova:creationTime>
Nov 16 05:37:18 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:37:18 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:37:18 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:37:18 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:37:18 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:37:18 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:37:18 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:37:18 user nova-compute[80928]:       <nova:owner>
Nov 16 05:37:18 user nova-compute[80928]:         <nova:user uuid="b59ee86b35a24e9680ce12033601b282">tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member</nova:user>
Nov 16 05:37:18 user nova-compute[80928]:         <nova:project uuid="699d28ce9a62462b909d1bb5dc801a0f">tempest-TestServerVolumeAttachScenarioOldVersion-879383734</nova:project>
Nov 16 05:37:18 user nova-compute[80928]:       </nova:owner>
Nov 16 05:37:18 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:37:18 user nova-compute[80928]:       <nova:ports>
Nov 16 05:37:18 user nova-compute[80928]:         <nova:port uuid="344ee51b-d7e6-4813-97b2-7434273589c3">
Nov 16 05:37:18 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 05:37:18 user nova-compute[80928]:         </nova:port>
Nov 16 05:37:18 user nova-compute[80928]:       </nova:ports>
Nov 16 05:37:18 user nova-compute[80928]:     </nova:instance>
Nov 16 05:37:18 user nova-compute[80928]:   </metadata>
Nov 16 05:37:18 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:37:18 user nova-compute[80928]:     <system>
Nov 16 05:37:18 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:37:18 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:37:18 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:37:18 user nova-compute[80928]:       <entry name="serial">3255dd8b-2060-470f-a4bb-08594977342e</entry>
Nov 16 05:37:18 user nova-compute[80928]:       <entry name="uuid">3255dd8b-2060-470f-a4bb-08594977342e</entry>
Nov 16 05:37:18 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:37:18 user nova-compute[80928]:     </system>
Nov 16 05:37:18 user nova-compute[80928]:   </sysinfo>
Nov 16 05:37:18 user nova-compute[80928]:   <os>
Nov 16 05:37:18 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:37:18 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:37:18 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:37:18 user nova-compute[80928]:   </os>
Nov 16 05:37:18 user nova-compute[80928]:   <features>
Nov 16 05:37:18 user nova-compute[80928]:     <acpi/>
Nov 16 05:37:18 user nova-compute[80928]:     <apic/>
Nov 16 05:37:18 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:37:18 user nova-compute[80928]:   </features>
Nov 16 05:37:18 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:37:18 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:37:18 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:37:18 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:37:18 user nova-compute[80928]:   </clock>
Nov 16 05:37:18 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:37:18 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:37:18 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:37:18 user nova-compute[80928]:   </cpu>
Nov 16 05:37:18 user nova-compute[80928]:   <devices>
Nov 16 05:37:18 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:37:18 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:37:18 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk"/>
Nov 16 05:37:18 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:37:18 user nova-compute[80928]:     </disk>
Nov 16 05:37:18 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:37:18 user nova-compute[80928]:       <mac address="fa:16:3e:81:8c:4a"/>
Nov 16 05:37:18 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:37:18 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:37:18 user nova-compute[80928]:       <target dev="tap344ee51b-d7"/>
Nov 16 05:37:18 user nova-compute[80928]:     </interface>
Nov 16 05:37:18 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:37:18 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/console.log" append="off"/>
Nov 16 05:37:18 user nova-compute[80928]:     </serial>
Nov 16 05:37:18 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:37:18 user nova-compute[80928]:     <video>
Nov 16 05:37:18 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:37:18 user nova-compute[80928]:     </video>
Nov 16 05:37:18 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:37:18 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:37:18 user nova-compute[80928]:     </rng>
Nov 16 05:37:18 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:37:18 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:37:18 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:37:18 user nova-compute[80928]:     </memballoon>
Nov 16 05:37:18 user nova-compute[80928]:   </devices>
Nov 16 05:37:18 user nova-compute[80928]: </domain>
Nov 16 05:37:18 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-578981665',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-578981665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5789816',id=24,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOpNxyZjC0M+TQHg+dvDC96vNDu0Jkf3PCKWAR8HSJ0LMcmPrjGcQrnW8lHJ9iJ958vYeYvWp8dZScTOUUxJpUcdTP/CPLSQ2PFk9DUkkt3o7J5eF00d0503JguQppNeA==',key_name='tempest-keypair-1961297760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='699d28ce9a62462b909d1bb5dc801a0f',ramdisk_id='',reservation_id='r-3rfohzf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-879383734',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b59ee86b35a24e9680ce12033601b282',uuid=3255dd8b-2060-470f-a4bb-08594977342e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "344ee51b-d7e6-4813-97b2-7434273589c3", "address": "fa:16:3e:81:8c:4a", "network": {"id": "07881f2c-0956-470f-89b1-166df36eee1d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-540690920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "699d28ce9a62462b909d1bb5dc801a0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344ee51b-d7", "ovs_interfaceid": "344ee51b-d7e6-4813-97b2-7434273589c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Converting VIF {"id": "344ee51b-d7e6-4813-97b2-7434273589c3", "address": "fa:16:3e:81:8c:4a", "network": {"id": "07881f2c-0956-470f-89b1-166df36eee1d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-540690920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "699d28ce9a62462b909d1bb5dc801a0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344ee51b-d7", "ovs_interfaceid": "344ee51b-d7e6-4813-97b2-7434273589c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:8c:4a,bridge_name='br-int',has_traffic_filtering=True,id=344ee51b-d7e6-4813-97b2-7434273589c3,network=Network(07881f2c-0956-470f-89b1-166df36eee1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344ee51b-d7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG os_vif [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:8c:4a,bridge_name='br-int',has_traffic_filtering=True,id=344ee51b-d7e6-4813-97b2-7434273589c3,network=Network(07881f2c-0956-470f-89b1-166df36eee1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344ee51b-d7') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b965274-b140-5dcc-8877-b243352e1448', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap344ee51b-d7, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap344ee51b-d7, col_values=(('qos', UUID('57fdd44f-7759-455d-a9ef-466dce5ded70')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap344ee51b-d7, col_values=(('external_ids', {'iface-id': '344ee51b-d7e6-4813-97b2-7434273589c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:8c:4a', 'vm-uuid': '3255dd8b-2060-470f-a4bb-08594977342e'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG os_brick.utils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:18 user nova-compute[80928]: INFO os_vif [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:8c:4a,bridge_name='br-int',has_traffic_filtering=True,id=344ee51b-d7e6-4813-97b2-7434273589c3,network=Network(07881f2c-0956-470f-89b1-166df36eee1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344ee51b-d7')
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb8a777-6c61-4fe3-a316-9e851c0c0ad4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8584420-bf8a-4ee3-9da9-6432a223fbaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeba9d22-2f6d-4177-9248-981bc79923c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3ba62b-a893-46c2-8b9d-7354a1675481]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] No VIF found with MAC fa:16:3e:81:8c:4a, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:37:18 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c7632b-847f-4721-a24f-a653991452a1]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG os_brick.utils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.network.neutron [req-6c96199d-6a34-4879-9ae3-67870d431ce4 req-cfc4b7ea-9b28-4d3f-b7ba-99c9fc8bd197 service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Updated VIF entry in instance network info cache for port 344ee51b-d7e6-4813-97b2-7434273589c3. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG nova.network.neutron [req-6c96199d-6a34-4879-9ae3-67870d431ce4 req-cfc4b7ea-9b28-4d3f-b7ba-99c9fc8bd197 service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Updating instance_info_cache with network_info: [{"id": "344ee51b-d7e6-4813-97b2-7434273589c3", "address": "fa:16:3e:81:8c:4a", "network": {"id": "07881f2c-0956-470f-89b1-166df36eee1d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-540690920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "699d28ce9a62462b909d1bb5dc801a0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344ee51b-d7", "ovs_interfaceid": "344ee51b-d7e6-4813-97b2-7434273589c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6c96199d-6a34-4879-9ae3-67870d431ce4 req-cfc4b7ea-9b28-4d3f-b7ba-99c9fc8bd197 service nova] Releasing lock "refresh_cache-3255dd8b-2060-470f-a4bb-08594977342e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:19 user nova-compute[80928]: DEBUG nova.compute.manager [req-20800328-0dc7-4f3e-839c-801215a895ef req-ec50b248-07d4-453e-a235-42a09103217e service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Received event network-vif-plugged-344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-20800328-0dc7-4f3e-839c-801215a895ef req-ec50b248-07d4-453e-a235-42a09103217e service nova] Acquiring lock "3255dd8b-2060-470f-a4bb-08594977342e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-20800328-0dc7-4f3e-839c-801215a895ef req-ec50b248-07d4-453e-a235-42a09103217e service nova] Lock "3255dd8b-2060-470f-a4bb-08594977342e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-20800328-0dc7-4f3e-839c-801215a895ef req-ec50b248-07d4-453e-a235-42a09103217e service nova] Lock "3255dd8b-2060-470f-a4bb-08594977342e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:19 user nova-compute[80928]: DEBUG nova.compute.manager [req-20800328-0dc7-4f3e-839c-801215a895ef req-ec50b248-07d4-453e-a235-42a09103217e service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] No waiting events found dispatching network-vif-plugged-344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:19 user nova-compute[80928]: WARNING nova.compute.manager [req-20800328-0dc7-4f3e-839c-801215a895ef req-ec50b248-07d4-453e-a235-42a09103217e service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Received unexpected event network-vif-plugged-344ee51b-d7e6-4813-97b2-7434273589c3 for instance with vm_state building and task_state spawning.
Nov 16 05:37:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "4a171080-2c54-4092-902d-7a3f815656b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:20 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:37:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:37:20 user nova-compute[80928]: INFO nova.compute.claims [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Claim successful on node user
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:37:21 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.policy [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ade947942acc48ef940224970f670985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8820092d2a4d50ab092ac90e5e1d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:37:21 user nova-compute[80928]: INFO nova.compute.claims [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Claim successful on node user
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:37:21 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Creating image(s)
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "/opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "/opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.204s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:21 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Instance spawned successfully.
Nov 16 05:37:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-ab90db14-14c8-4c19-a235-0df2b2186a88 req-3471c779-9a86-40df-97db-c3d9d8c4105d service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Received event network-vif-plugged-344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ab90db14-14c8-4c19-a235-0df2b2186a88 req-3471c779-9a86-40df-97db-c3d9d8c4105d service nova] Acquiring lock "3255dd8b-2060-470f-a4bb-08594977342e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ab90db14-14c8-4c19-a235-0df2b2186a88 req-3471c779-9a86-40df-97db-c3d9d8c4105d service nova] Lock "3255dd8b-2060-470f-a4bb-08594977342e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ab90db14-14c8-4c19-a235-0df2b2186a88 req-3471c779-9a86-40df-97db-c3d9d8c4105d service nova] Lock "3255dd8b-2060-470f-a4bb-08594977342e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-ab90db14-14c8-4c19-a235-0df2b2186a88 req-3471c779-9a86-40df-97db-c3d9d8c4105d service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] No waiting events found dispatching network-vif-plugged-344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:22 user nova-compute[80928]: WARNING nova.compute.manager [req-ab90db14-14c8-4c19-a235-0df2b2186a88 req-3471c779-9a86-40df-97db-c3d9d8c4105d service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Received unexpected event network-vif-plugged-344ee51b-d7e6-4813-97b2-7434273589c3 for instance with vm_state building and task_state spawning.
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Successfully created port: 0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:37:22 user nova-compute[80928]: INFO nova.compute.manager [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk 1073741824" returned: 0 in 0.067s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:22 user nova-compute[80928]: INFO nova.compute.manager [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Took 7.78 seconds to build instance.
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:37:22 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b26c9959-b0d5-4006-8a96-8d30b85d785f tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "3255dd8b-2060-470f-a4bb-08594977342e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.938s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Cannot resize image /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Ensure instance console log exists: /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:37:22 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Creating image(s)
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "/opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "/opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.policy [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ade947942acc48ef940224970f670985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8820092d2a4d50ab092ac90e5e1d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Successfully updated port: 0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquired lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-42480935-1feb-4046-8bd6-15d89a4e0367 req-490ea139-910d-4a50-9d9c-96d430c60e48 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-changed-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-42480935-1feb-4046-8bd6-15d89a4e0367 req-490ea139-910d-4a50-9d9c-96d430c60e48 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Refreshing instance network info cache due to event network-changed-0876efd5-37cf-44b7-b6da-1c02bc4f33b0. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-42480935-1feb-4046-8bd6-15d89a4e0367 req-490ea139-910d-4a50-9d9c-96d430c60e48 service nova] Acquiring lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk 1073741824" returned: 0 in 0.059s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Cannot resize image /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Ensure instance console log exists: /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Updating instance_info_cache with network_info: [{"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Releasing lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Instance network_info: |[{"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-42480935-1feb-4046-8bd6-15d89a4e0367 req-490ea139-910d-4a50-9d9c-96d430c60e48 service nova] Acquired lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-42480935-1feb-4046-8bd6-15d89a4e0367 req-490ea139-910d-4a50-9d9c-96d430c60e48 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Refreshing network info cache for port 0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Start _get_guest_xml network_info=[{"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:37:23 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:37:23 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-778331140',display_name='tempest-ServerRescueNegativeTestJSON-server-778331140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-778331140',id=25,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8820092d2a4d50ab092ac90e5e1d3d',ramdisk_id='',reservation_id='r-uqenc8b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-575506684',owner_user_name='tempest-ServerRescueNegativeTestJSON-575506684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:22Z,user_data=None,user_id='ade947942acc48ef940224970f670985',uuid=4a171080-2c54-4092-902d-7a3f815656b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converting VIF {"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c7:d5,bridge_name='br-int',has_traffic_filtering=True,id=0876efd5-37cf-44b7-b6da-1c02bc4f33b0,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0876efd5-37') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a171080-2c54-4092-902d-7a3f815656b9 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:37:23 user nova-compute[80928]:   <uuid>4a171080-2c54-4092-902d-7a3f815656b9</uuid>
Nov 16 05:37:23 user nova-compute[80928]:   <name>instance-00000019</name>
Nov 16 05:37:23 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:37:23 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:37:23 user nova-compute[80928]:   <metadata>
Nov 16 05:37:23 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:37:23 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:37:23 user nova-compute[80928]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-778331140</nova:name>
Nov 16 05:37:23 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:37:23</nova:creationTime>
Nov 16 05:37:23 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:37:23 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:37:23 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:37:23 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:37:23 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:37:23 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:37:23 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:37:23 user nova-compute[80928]:       <nova:owner>
Nov 16 05:37:23 user nova-compute[80928]:         <nova:user uuid="ade947942acc48ef940224970f670985">tempest-ServerRescueNegativeTestJSON-575506684-project-member</nova:user>
Nov 16 05:37:23 user nova-compute[80928]:         <nova:project uuid="bf8820092d2a4d50ab092ac90e5e1d3d">tempest-ServerRescueNegativeTestJSON-575506684</nova:project>
Nov 16 05:37:23 user nova-compute[80928]:       </nova:owner>
Nov 16 05:37:23 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:37:23 user nova-compute[80928]:       <nova:ports>
Nov 16 05:37:23 user nova-compute[80928]:         <nova:port uuid="0876efd5-37cf-44b7-b6da-1c02bc4f33b0">
Nov 16 05:37:23 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:37:23 user nova-compute[80928]:         </nova:port>
Nov 16 05:37:23 user nova-compute[80928]:       </nova:ports>
Nov 16 05:37:23 user nova-compute[80928]:     </nova:instance>
Nov 16 05:37:23 user nova-compute[80928]:   </metadata>
Nov 16 05:37:23 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:37:23 user nova-compute[80928]:     <system>
Nov 16 05:37:23 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:37:23 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:37:23 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:37:23 user nova-compute[80928]:       <entry name="serial">4a171080-2c54-4092-902d-7a3f815656b9</entry>
Nov 16 05:37:23 user nova-compute[80928]:       <entry name="uuid">4a171080-2c54-4092-902d-7a3f815656b9</entry>
Nov 16 05:37:23 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:37:23 user nova-compute[80928]:     </system>
Nov 16 05:37:23 user nova-compute[80928]:   </sysinfo>
Nov 16 05:37:23 user nova-compute[80928]:   <os>
Nov 16 05:37:23 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:37:23 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:37:23 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:37:23 user nova-compute[80928]:   </os>
Nov 16 05:37:23 user nova-compute[80928]:   <features>
Nov 16 05:37:23 user nova-compute[80928]:     <acpi/>
Nov 16 05:37:23 user nova-compute[80928]:     <apic/>
Nov 16 05:37:23 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:37:23 user nova-compute[80928]:   </features>
Nov 16 05:37:23 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:37:23 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:37:23 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:37:23 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:37:23 user nova-compute[80928]:   </clock>
Nov 16 05:37:23 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:37:23 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:37:23 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:37:23 user nova-compute[80928]:   </cpu>
Nov 16 05:37:23 user nova-compute[80928]:   <devices>
Nov 16 05:37:23 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:37:23 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:37:23 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk"/>
Nov 16 05:37:23 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:37:23 user nova-compute[80928]:     </disk>
Nov 16 05:37:23 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:37:23 user nova-compute[80928]:       <mac address="fa:16:3e:a4:c7:d5"/>
Nov 16 05:37:23 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:37:23 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:37:23 user nova-compute[80928]:       <target dev="tap0876efd5-37"/>
Nov 16 05:37:23 user nova-compute[80928]:     </interface>
Nov 16 05:37:23 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:37:23 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/console.log" append="off"/>
Nov 16 05:37:23 user nova-compute[80928]:     </serial>
Nov 16 05:37:23 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:37:23 user nova-compute[80928]:     <video>
Nov 16 05:37:23 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:37:23 user nova-compute[80928]:     </video>
Nov 16 05:37:23 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:37:23 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:37:23 user nova-compute[80928]:     </rng>
Nov 16 05:37:23 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:37:23 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:37:23 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:37:23 user nova-compute[80928]:     </memballoon>
Nov 16 05:37:23 user nova-compute[80928]:   </devices>
Nov 16 05:37:23 user nova-compute[80928]: </domain>
Nov 16 05:37:23 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-778331140',display_name='tempest-ServerRescueNegativeTestJSON-server-778331140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-778331140',id=25,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8820092d2a4d50ab092ac90e5e1d3d',ramdisk_id='',reservation_id='r-uqenc8b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-575506684',owner_user_name='tempest-ServerRescueNegativeTestJSON-575506684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:22Z,user_data=None,user_id='ade947942acc48ef940224970f670985',uuid=4a171080-2c54-4092-902d-7a3f815656b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converting VIF {"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c7:d5,bridge_name='br-int',has_traffic_filtering=True,id=0876efd5-37cf-44b7-b6da-1c02bc4f33b0,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0876efd5-37') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG os_vif [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c7:d5,bridge_name='br-int',has_traffic_filtering=True,id=0876efd5-37cf-44b7-b6da-1c02bc4f33b0,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0876efd5-37') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7dc94cf9-b678-58db-b44b-54e7d2bfecc7', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0876efd5-37, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0876efd5-37, col_values=(('qos', UUID('1a5a448a-4cee-48d8-9b7b-adb0d523e53e')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0876efd5-37, col_values=(('external_ids', {'iface-id': '0876efd5-37cf-44b7-b6da-1c02bc4f33b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:c7:d5', 'vm-uuid': '4a171080-2c54-4092-902d-7a3f815656b9'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:23 user nova-compute[80928]: INFO os_vif [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c7:d5,bridge_name='br-int',has_traffic_filtering=True,id=0876efd5-37cf-44b7-b6da-1c02bc4f33b0,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0876efd5-37')
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No VIF found with MAC fa:16:3e:a4:c7:d5, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Successfully created port: d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-42480935-1feb-4046-8bd6-15d89a4e0367 req-490ea139-910d-4a50-9d9c-96d430c60e48 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Updated VIF entry in instance network info cache for port 0876efd5-37cf-44b7-b6da-1c02bc4f33b0. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-42480935-1feb-4046-8bd6-15d89a4e0367 req-490ea139-910d-4a50-9d9c-96d430c60e48 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Updating instance_info_cache with network_info: [{"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-42480935-1feb-4046-8bd6-15d89a4e0367 req-490ea139-910d-4a50-9d9c-96d430c60e48 service nova] Releasing lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Successfully updated port: d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:37:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:37:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquired lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:37:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:37:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-7ccdcc34-f1bf-459e-afe7-184760cca944 req-79b48103-d786-483e-9e8e-a25e2613e8d7 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received event network-changed-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-7ccdcc34-f1bf-459e-afe7-184760cca944 req-79b48103-d786-483e-9e8e-a25e2613e8d7 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Refreshing instance network info cache due to event network-changed-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:37:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7ccdcc34-f1bf-459e-afe7-184760cca944 req-79b48103-d786-483e-9e8e-a25e2613e8d7 service nova] Acquiring lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:37:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.network.neutron [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Updating instance_info_cache with network_info: [{"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Releasing lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Instance network_info: |[{"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7ccdcc34-f1bf-459e-afe7-184760cca944 req-79b48103-d786-483e-9e8e-a25e2613e8d7 service nova] Acquired lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.network.neutron [req-7ccdcc34-f1bf-459e-afe7-184760cca944 req-79b48103-d786-483e-9e8e-a25e2613e8d7 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Refreshing network info cache for port d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Start _get_guest_xml network_info=[{"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:37:25 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:37:25 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-157193833',display_name='tempest-ServerRescueNegativeTestJSON-server-157193833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-157193833',id=26,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8820092d2a4d50ab092ac90e5e1d3d',ramdisk_id='',reservation_id='r-hcgyag60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-575506684',owner_user_name='tempest-ServerRescueNegativeTestJSON-575506684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:23Z,user_data=None,user_id='ade947942acc48ef940224970f670985',uuid=2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converting VIF {"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6c:ee,bridge_name='br-int',has_traffic_filtering=True,id=d4f7139c-fa6d-4a1b-9353-8edcf9a38d18,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f7139c-fa') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.objects.instance [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:37:25 user nova-compute[80928]:   <uuid>2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a</uuid>
Nov 16 05:37:25 user nova-compute[80928]:   <name>instance-0000001a</name>
Nov 16 05:37:25 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:37:25 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:37:25 user nova-compute[80928]:   <metadata>
Nov 16 05:37:25 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:37:25 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:37:25 user nova-compute[80928]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-157193833</nova:name>
Nov 16 05:37:25 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:37:25</nova:creationTime>
Nov 16 05:37:25 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:37:25 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:37:25 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:37:25 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:37:25 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:37:25 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:37:25 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:37:25 user nova-compute[80928]:       <nova:owner>
Nov 16 05:37:25 user nova-compute[80928]:         <nova:user uuid="ade947942acc48ef940224970f670985">tempest-ServerRescueNegativeTestJSON-575506684-project-member</nova:user>
Nov 16 05:37:25 user nova-compute[80928]:         <nova:project uuid="bf8820092d2a4d50ab092ac90e5e1d3d">tempest-ServerRescueNegativeTestJSON-575506684</nova:project>
Nov 16 05:37:25 user nova-compute[80928]:       </nova:owner>
Nov 16 05:37:25 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:37:25 user nova-compute[80928]:       <nova:ports>
Nov 16 05:37:25 user nova-compute[80928]:         <nova:port uuid="d4f7139c-fa6d-4a1b-9353-8edcf9a38d18">
Nov 16 05:37:25 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 05:37:25 user nova-compute[80928]:         </nova:port>
Nov 16 05:37:25 user nova-compute[80928]:       </nova:ports>
Nov 16 05:37:25 user nova-compute[80928]:     </nova:instance>
Nov 16 05:37:25 user nova-compute[80928]:   </metadata>
Nov 16 05:37:25 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:37:25 user nova-compute[80928]:     <system>
Nov 16 05:37:25 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:37:25 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:37:25 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:37:25 user nova-compute[80928]:       <entry name="serial">2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a</entry>
Nov 16 05:37:25 user nova-compute[80928]:       <entry name="uuid">2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a</entry>
Nov 16 05:37:25 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:37:25 user nova-compute[80928]:     </system>
Nov 16 05:37:25 user nova-compute[80928]:   </sysinfo>
Nov 16 05:37:25 user nova-compute[80928]:   <os>
Nov 16 05:37:25 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:37:25 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:37:25 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:37:25 user nova-compute[80928]:   </os>
Nov 16 05:37:25 user nova-compute[80928]:   <features>
Nov 16 05:37:25 user nova-compute[80928]:     <acpi/>
Nov 16 05:37:25 user nova-compute[80928]:     <apic/>
Nov 16 05:37:25 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:37:25 user nova-compute[80928]:   </features>
Nov 16 05:37:25 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:37:25 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:37:25 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:37:25 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:37:25 user nova-compute[80928]:   </clock>
Nov 16 05:37:25 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:37:25 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:37:25 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:37:25 user nova-compute[80928]:   </cpu>
Nov 16 05:37:25 user nova-compute[80928]:   <devices>
Nov 16 05:37:25 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:37:25 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:37:25 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk"/>
Nov 16 05:37:25 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:37:25 user nova-compute[80928]:     </disk>
Nov 16 05:37:25 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:37:25 user nova-compute[80928]:       <mac address="fa:16:3e:0c:6c:ee"/>
Nov 16 05:37:25 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:37:25 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:37:25 user nova-compute[80928]:       <target dev="tapd4f7139c-fa"/>
Nov 16 05:37:25 user nova-compute[80928]:     </interface>
Nov 16 05:37:25 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:37:25 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/console.log" append="off"/>
Nov 16 05:37:25 user nova-compute[80928]:     </serial>
Nov 16 05:37:25 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:37:25 user nova-compute[80928]:     <video>
Nov 16 05:37:25 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:37:25 user nova-compute[80928]:     </video>
Nov 16 05:37:25 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:37:25 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:37:25 user nova-compute[80928]:     </rng>
Nov 16 05:37:25 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:37:25 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:37:25 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:37:25 user nova-compute[80928]:     </memballoon>
Nov 16 05:37:25 user nova-compute[80928]:   </devices>
Nov 16 05:37:25 user nova-compute[80928]: </domain>
Nov 16 05:37:25 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-157193833',display_name='tempest-ServerRescueNegativeTestJSON-server-157193833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-157193833',id=26,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8820092d2a4d50ab092ac90e5e1d3d',ramdisk_id='',reservation_id='r-hcgyag60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-575506684',owner_user_name='tempest-ServerRescueNegativeTestJSON-575506684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:23Z,user_data=None,user_id='ade947942acc48ef940224970f670985',uuid=2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converting VIF {"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6c:ee,bridge_name='br-int',has_traffic_filtering=True,id=d4f7139c-fa6d-4a1b-9353-8edcf9a38d18,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f7139c-fa') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG os_vif [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6c:ee,bridge_name='br-int',has_traffic_filtering=True,id=d4f7139c-fa6d-4a1b-9353-8edcf9a38d18,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f7139c-fa') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd360ee60-fee2-5a8e-b346-caaeb73064e6', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4f7139c-fa, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4f7139c-fa, col_values=(('qos', UUID('02a98fe1-1df5-4670-9dc2-d678e5583934')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4f7139c-fa, col_values=(('external_ids', {'iface-id': 'd4f7139c-fa6d-4a1b-9353-8edcf9a38d18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:6c:ee', 'vm-uuid': '2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: INFO os_vif [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6c:ee,bridge_name='br-int',has_traffic_filtering=True,id=d4f7139c-fa6d-4a1b-9353-8edcf9a38d18,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f7139c-fa')
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No VIF found with MAC fa:16:3e:0c:6c:ee, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-50b70d57-3cad-4679-aad1-cfe848678279 req-4e324607-c906-48a9-b363-5e6e71f0d550 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-50b70d57-3cad-4679-aad1-cfe848678279 req-4e324607-c906-48a9-b363-5e6e71f0d550 service nova] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-50b70d57-3cad-4679-aad1-cfe848678279 req-4e324607-c906-48a9-b363-5e6e71f0d550 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-50b70d57-3cad-4679-aad1-cfe848678279 req-4e324607-c906-48a9-b363-5e6e71f0d550 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-50b70d57-3cad-4679-aad1-cfe848678279 req-4e324607-c906-48a9-b363-5e6e71f0d550 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] No waiting events found dispatching network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:25 user nova-compute[80928]: WARNING nova.compute.manager [req-50b70d57-3cad-4679-aad1-cfe848678279 req-4e324607-c906-48a9-b363-5e6e71f0d550 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received unexpected event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 for instance with vm_state building and task_state spawning.
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.network.neutron [req-7ccdcc34-f1bf-459e-afe7-184760cca944 req-79b48103-d786-483e-9e8e-a25e2613e8d7 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Updated VIF entry in instance network info cache for port d4f7139c-fa6d-4a1b-9353-8edcf9a38d18. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.network.neutron [req-7ccdcc34-f1bf-459e-afe7-184760cca944 req-79b48103-d786-483e-9e8e-a25e2613e8d7 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Updating instance_info_cache with network_info: [{"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7ccdcc34-f1bf-459e-afe7-184760cca944 req-79b48103-d786-483e-9e8e-a25e2613e8d7 service nova] Releasing lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-6edf7ee2-9da2-4c18-898a-3b44933d53e6 req-6189dc62-50db-41e2-b294-fd17899a2dad service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Received event network-changed-bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-6edf7ee2-9da2-4c18-898a-3b44933d53e6 req-6189dc62-50db-41e2-b294-fd17899a2dad service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Refreshing instance network info cache due to event network-changed-bcb8857b-e339-4e3f-909d-d687fc8481fd. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6edf7ee2-9da2-4c18-898a-3b44933d53e6 req-6189dc62-50db-41e2-b294-fd17899a2dad service nova] Acquiring lock "refresh_cache-9b3672c1-d287-4caa-b022-aa088d51b97a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6edf7ee2-9da2-4c18-898a-3b44933d53e6 req-6189dc62-50db-41e2-b294-fd17899a2dad service nova] Acquired lock "refresh_cache-9b3672c1-d287-4caa-b022-aa088d51b97a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG nova.network.neutron [req-6edf7ee2-9da2-4c18-898a-3b44933d53e6 req-6189dc62-50db-41e2-b294-fd17899a2dad service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Refreshing network info cache for port bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:26 user nova-compute[80928]: DEBUG nova.network.neutron [req-6edf7ee2-9da2-4c18-898a-3b44933d53e6 req-6189dc62-50db-41e2-b294-fd17899a2dad service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Updated VIF entry in instance network info cache for port bcb8857b-e339-4e3f-909d-d687fc8481fd. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:37:26 user nova-compute[80928]: DEBUG nova.network.neutron [req-6edf7ee2-9da2-4c18-898a-3b44933d53e6 req-6189dc62-50db-41e2-b294-fd17899a2dad service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Updating instance_info_cache with network_info: [{"id": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "address": "fa:16:3e:f0:11:e0", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb8857b-e3", "ovs_interfaceid": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6edf7ee2-9da2-4c18-898a-3b44933d53e6 req-6189dc62-50db-41e2-b294-fd17899a2dad service nova] Releasing lock "refresh_cache-9b3672c1-d287-4caa-b022-aa088d51b97a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-3acb8256-b42d-432b-944b-e5eb96a1183b req-73f538bd-f9d6-4de7-a015-88a969c00ca8 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3acb8256-b42d-432b-944b-e5eb96a1183b req-73f538bd-f9d6-4de7-a015-88a969c00ca8 service nova] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3acb8256-b42d-432b-944b-e5eb96a1183b req-73f538bd-f9d6-4de7-a015-88a969c00ca8 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3acb8256-b42d-432b-944b-e5eb96a1183b req-73f538bd-f9d6-4de7-a015-88a969c00ca8 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-3acb8256-b42d-432b-944b-e5eb96a1183b req-73f538bd-f9d6-4de7-a015-88a969c00ca8 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] No waiting events found dispatching network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:27 user nova-compute[80928]: WARNING nova.compute.manager [req-3acb8256-b42d-432b-944b-e5eb96a1183b req-73f538bd-f9d6-4de7-a015-88a969c00ca8 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received unexpected event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 for instance with vm_state building and task_state spawning.
Nov 16 05:37:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Starting finish_migration {{(pid=80928) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Instance directory exists: not creating {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 05:37:27 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Creating image(s)
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk. size=21474836480 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-f9d087d6-2baf-4a47-b33f-5a064b500470 req-89f1a38c-9620-4ec6-b8cf-972f704f6087 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received event network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f9d087d6-2baf-4a47-b33f-5a064b500470 req-89f1a38c-9620-4ec6-b8cf-972f704f6087 service nova] Acquiring lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f9d087d6-2baf-4a47-b33f-5a064b500470 req-89f1a38c-9620-4ec6-b8cf-972f704f6087 service nova] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f9d087d6-2baf-4a47-b33f-5a064b500470 req-89f1a38c-9620-4ec6-b8cf-972f704f6087 service nova] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-f9d087d6-2baf-4a47-b33f-5a064b500470 req-89f1a38c-9620-4ec6-b8cf-972f704f6087 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] No waiting events found dispatching network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:27 user nova-compute[80928]: WARNING nova.compute.manager [req-f9d087d6-2baf-4a47-b33f-5a064b500470 req-89f1a38c-9620-4ec6-b8cf-972f704f6087 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received unexpected event network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 for instance with vm_state building and task_state spawning.
Nov 16 05:37:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-f9d087d6-2baf-4a47-b33f-5a064b500470 req-89f1a38c-9620-4ec6-b8cf-972f704f6087 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received event network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f9d087d6-2baf-4a47-b33f-5a064b500470 req-89f1a38c-9620-4ec6-b8cf-972f704f6087 service nova] Acquiring lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f9d087d6-2baf-4a47-b33f-5a064b500470 req-89f1a38c-9620-4ec6-b8cf-972f704f6087 service nova] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f9d087d6-2baf-4a47-b33f-5a064b500470 req-89f1a38c-9620-4ec6-b8cf-972f704f6087 service nova] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-f9d087d6-2baf-4a47-b33f-5a064b500470 req-89f1a38c-9620-4ec6-b8cf-972f704f6087 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] No waiting events found dispatching network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:27 user nova-compute[80928]: WARNING nova.compute.manager [req-f9d087d6-2baf-4a47-b33f-5a064b500470 req-89f1a38c-9620-4ec6-b8cf-972f704f6087 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received unexpected event network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 for instance with vm_state building and task_state spawning.
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk 21474836480 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk 21474836480" returned: 0 in 0.051s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Ensure instance console log exists: /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Start _get_guest_xml network_info=[{"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1526085965-network", "vif_mac": "fa:16:3e:58:5c:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNroILOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc', 'attached_at': '2023-11-16T05:37:27.000000', 'detached_at': '', 'volume_id': '04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'serial': '04b116c5-edf0-4afd-b73c-74bef2ce3b13'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'bddd49e6-5139-4fcc-925e-47d0758d6833', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:37:28 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:37:28 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNroILOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:37:28 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:37:28 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:37:28 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[db62f097-f6cc-4fdd-9f4c-49b3242916ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:37:28 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d994b5f8-4108-487b-96c1-83cd0fae7d9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13] added
Nov 16 05:37:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4a7ded-2b68-49e0-b61c-96dbe9c3f174]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[07751b9d-20c2-4bad-9ef0-507b179ea7ea]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNroILOF {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNroILOF" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1daab07-bf91-496c-aec4-ed481834f9e0]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vNroILOF'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9c18fe-1777-47f2-8399-3b7f21b3ecaf]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b2632b-4d82-43f8-82de-5b0f39111e89]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f042610-2f19-431f-a9ad-493cebee8c76 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f042610-2f19-431f-a9ad-493cebee8c76 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f042610-2f19-431f-a9ad-493cebee8c76 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a67eba-d706-438a-a939-b0f3411030f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260]
Nov 16 05:37:28 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260] successful.
Nov 16 05:37:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c242474f-f470-4876-87fb-ae9e160c8ca5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[75230809-ca62-4a6d-b971-46c40f4c7202]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f042610-2f19-431f-a9ad-493cebee8c76 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f042610-2f19-431f-a9ad-493cebee8c76 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f042610-2f19-431f-a9ad-493cebee8c76 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:37:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] HCTL ('38', '-', '-', 0) found on session 28 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[19baca73-8c9d-464c-9355-6692e65ff5c1]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNroILOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "9b3672c1-d287-4caa-b022-aa088d51b97a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.objects.instance [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'flavor' on Instance uuid 9b3672c1-d287-4caa-b022-aa088d51b97a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "9b3672c1-d287-4caa-b022-aa088d51b97a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:28 user nova-compute[80928]: INFO nova.compute.manager [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Attaching volume ce768e16-309a-4f17-a51c-e7fbf97803ec to /dev/vdb
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.utils [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:37:28 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Instance spawned successfully.
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6112d0-6a65-4924-8314-3efd931fef5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ad60ad-e9c1-4102-80cc-df8ceb4ff2cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9aec01-e79e-4f1b-bad5-080cde275910]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8db53f-7a1a-4e8c-ac26-08ec25afcba4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:28 user nova-compute[80928]: INFO nova.compute.manager [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Took 7.26 seconds to spawn the instance on the hypervisor.
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:37:28 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:37:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dbeff5-51cf-49cb-a6a1-c3edec16c154]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG os_brick.utils [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:37:28 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Updating existing volume attachment record: d978eaac-a5b9-4cbf-aa1b-d83e89b2dbcc {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:37:29 user nova-compute[80928]: INFO nova.compute.manager [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Took 8.18 seconds to build instance.
Nov 16 05:37:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1439d194-9fab-44c9-b55b-83d9453a75e0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "4a171080-2c54-4092-902d-7a3f815656b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.275s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:37:29 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Instance spawned successfully.
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23139393564656463', 'path': '/dev/sdg'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139393564656463', 'path': '/dev/sdg'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:33:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1720886813',display_name='tempest-ServerActionsTestOtherB-server-1720886813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1720886813',id=19,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9liT9/8OcIK+JyCDfTMk3trFPyZpf/7B0mBbUikRHMSTPB1lcjCLvTtHnBj5VmxOBF7smgL7oBOajybgsCgVmXQlH849r5LdVXz3wtlHkH2OG/ZZJDnudNBjLF68+HYQ==',key_name='tempest-keypair-454342651',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:33:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1a8884142201406a89f46fdfcfb7cb7e',ramdisk_id='',reservation_id='r-0aqy2onj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1064773206',owner_user_name='tempest-ServerActionsTestOtherB-1064773206-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea9806dcc82048899583dd9f738c109d',uuid=431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1526085965-network", "vif_mac": "fa:16:3e:58:5c:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converting VIF {"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1526085965-network", "vif_mac": "fa:16:3e:58:5c:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:37:29 user nova-compute[80928]:   <uuid>431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc</uuid>
Nov 16 05:37:29 user nova-compute[80928]:   <name>instance-00000013</name>
Nov 16 05:37:29 user nova-compute[80928]:   <memory>2097152</memory>
Nov 16 05:37:29 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:37:29 user nova-compute[80928]:   <metadata>
Nov 16 05:37:29 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:37:29 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:37:29 user nova-compute[80928]:       <nova:name>tempest-ServerActionsTestOtherB-server-1720886813</nova:name>
Nov 16 05:37:29 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:37:28</nova:creationTime>
Nov 16 05:37:29 user nova-compute[80928]:       <nova:flavor name="m1.small">
Nov 16 05:37:29 user nova-compute[80928]:         <nova:memory>2048</nova:memory>
Nov 16 05:37:29 user nova-compute[80928]:         <nova:disk>20</nova:disk>
Nov 16 05:37:29 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:37:29 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:37:29 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:37:29 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:37:29 user nova-compute[80928]:       <nova:owner>
Nov 16 05:37:29 user nova-compute[80928]:         <nova:user uuid="ea9806dcc82048899583dd9f738c109d">tempest-ServerActionsTestOtherB-1064773206-project-member</nova:user>
Nov 16 05:37:29 user nova-compute[80928]:         <nova:project uuid="1a8884142201406a89f46fdfcfb7cb7e">tempest-ServerActionsTestOtherB-1064773206</nova:project>
Nov 16 05:37:29 user nova-compute[80928]:       </nova:owner>
Nov 16 05:37:29 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:37:29 user nova-compute[80928]:       <nova:ports>
Nov 16 05:37:29 user nova-compute[80928]:         <nova:port uuid="42b5d66c-7f70-41b3-b29c-58333c62c7f2">
Nov 16 05:37:29 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 05:37:29 user nova-compute[80928]:         </nova:port>
Nov 16 05:37:29 user nova-compute[80928]:       </nova:ports>
Nov 16 05:37:29 user nova-compute[80928]:     </nova:instance>
Nov 16 05:37:29 user nova-compute[80928]:   </metadata>
Nov 16 05:37:29 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:37:29 user nova-compute[80928]:     <system>
Nov 16 05:37:29 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:37:29 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:37:29 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:37:29 user nova-compute[80928]:       <entry name="serial">431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc</entry>
Nov 16 05:37:29 user nova-compute[80928]:       <entry name="uuid">431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc</entry>
Nov 16 05:37:29 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:37:29 user nova-compute[80928]:     </system>
Nov 16 05:37:29 user nova-compute[80928]:   </sysinfo>
Nov 16 05:37:29 user nova-compute[80928]:   <os>
Nov 16 05:37:29 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:37:29 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:37:29 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:37:29 user nova-compute[80928]:   </os>
Nov 16 05:37:29 user nova-compute[80928]:   <features>
Nov 16 05:37:29 user nova-compute[80928]:     <acpi/>
Nov 16 05:37:29 user nova-compute[80928]:     <apic/>
Nov 16 05:37:29 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:37:29 user nova-compute[80928]:   </features>
Nov 16 05:37:29 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:37:29 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:37:29 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:37:29 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:37:29 user nova-compute[80928]:   </clock>
Nov 16 05:37:29 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:37:29 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:37:29 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:37:29 user nova-compute[80928]:   </cpu>
Nov 16 05:37:29 user nova-compute[80928]:   <devices>
Nov 16 05:37:29 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:37:29 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:37:29 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk"/>
Nov 16 05:37:29 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:37:29 user nova-compute[80928]:     </disk>
Nov 16 05:37:29 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:37:29 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:37:29 user nova-compute[80928]:       <source dev="/dev/sdg"/>
Nov 16 05:37:29 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:37:29 user nova-compute[80928]:       <serial>04b116c5-edf0-4afd-b73c-74bef2ce3b13</serial>
Nov 16 05:37:29 user nova-compute[80928]:     </disk>
Nov 16 05:37:29 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:37:29 user nova-compute[80928]:       <mac address="fa:16:3e:58:5c:e5"/>
Nov 16 05:37:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:37:29 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:37:29 user nova-compute[80928]:       <target dev="tap42b5d66c-7f"/>
Nov 16 05:37:29 user nova-compute[80928]:     </interface>
Nov 16 05:37:29 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:37:29 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/console.log" append="off"/>
Nov 16 05:37:29 user nova-compute[80928]:     </serial>
Nov 16 05:37:29 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:37:29 user nova-compute[80928]:     <video>
Nov 16 05:37:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:37:29 user nova-compute[80928]:     </video>
Nov 16 05:37:29 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:37:29 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:37:29 user nova-compute[80928]:     </rng>
Nov 16 05:37:29 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:37:29 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:37:29 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:37:29 user nova-compute[80928]:     </memballoon>
Nov 16 05:37:29 user nova-compute[80928]:   </devices>
Nov 16 05:37:29 user nova-compute[80928]: </domain>
Nov 16 05:37:29 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:33:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1720886813',display_name='tempest-ServerActionsTestOtherB-server-1720886813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1720886813',id=19,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9liT9/8OcIK+JyCDfTMk3trFPyZpf/7B0mBbUikRHMSTPB1lcjCLvTtHnBj5VmxOBF7smgL7oBOajybgsCgVmXQlH849r5LdVXz3wtlHkH2OG/ZZJDnudNBjLF68+HYQ==',key_name='tempest-keypair-454342651',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:33:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1a8884142201406a89f46fdfcfb7cb7e',ramdisk_id='',reservation_id='r-0aqy2onj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1064773206',owner_user_name='tempest-ServerActionsTestOtherB-1064773206-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea9806dcc82048899583dd9f738c109d',uuid=431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1526085965-network", "vif_mac": "fa:16:3e:58:5c:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converting VIF {"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1526085965-network", "vif_mac": "fa:16:3e:58:5c:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG os_vif [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e1511b2-4dd6-5162-9e3f-54d9378556da', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:29 user nova-compute[80928]: INFO nova.compute.manager [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42b5d66c-7f, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42b5d66c-7f, col_values=(('qos', UUID('e4131d9b-4d51-42b3-9bd2-5815f6873b0e')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42b5d66c-7f, col_values=(('external_ids', {'iface-id': '42b5d66c-7f70-41b3-b29c-58333c62c7f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:5c:e5', 'vm-uuid': '431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:29 user nova-compute[80928]: INFO os_vif [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f')
Nov 16 05:37:29 user nova-compute[80928]: INFO nova.compute.manager [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Took 8.05 seconds to build instance.
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] No VIF found with MAC fa:16:3e:58:5c:e5, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:37:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0b9e5f04-187c-447e-9327-b4ce28773836 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.168s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-5d7478bd-2892-4db4-b3be-39e21cd5bb45 req-fc5ae501-4ff4-4238-97db-f42f18d8f2c0 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5d7478bd-2892-4db4-b3be-39e21cd5bb45 req-fc5ae501-4ff4-4238-97db-f42f18d8f2c0 service nova] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5d7478bd-2892-4db4-b3be-39e21cd5bb45 req-fc5ae501-4ff4-4238-97db-f42f18d8f2c0 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5d7478bd-2892-4db4-b3be-39e21cd5bb45 req-fc5ae501-4ff4-4238-97db-f42f18d8f2c0 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-5d7478bd-2892-4db4-b3be-39e21cd5bb45 req-fc5ae501-4ff4-4238-97db-f42f18d8f2c0 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] No waiting events found dispatching network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:31 user nova-compute[80928]: WARNING nova.compute.manager [req-5d7478bd-2892-4db4-b3be-39e21cd5bb45 req-fc5ae501-4ff4-4238-97db-f42f18d8f2c0 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received unexpected event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 for instance with vm_state active and task_state resize_finish.
Nov 16 05:37:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "310c7fc9-af32-42dd-be30-8460daa03279" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "310c7fc9-af32-42dd-be30-8460daa03279" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:37:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:32 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:37:32 user nova-compute[80928]: INFO nova.compute.claims [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Claim successful on node user
Nov 16 05:37:33 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:37:33 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:37:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.853s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:33 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:37:33 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:37:33 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:37:33 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:37:33 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:37:33 user nova-compute[80928]: DEBUG nova.policy [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bb9af29de44488282666171f2bcad47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995121e71e234f60b7f7d5ac0abcc0f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:37:33 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:37:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:37:33 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Creating image(s)
Nov 16 05:37:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "/opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "/opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "/opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-1fbe0d73-e5e4-4c06-bbce-20b9599a925c req-092745e5-0861-4492-8210-476cc8930a12 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1fbe0d73-e5e4-4c06-bbce-20b9599a925c req-092745e5-0861-4492-8210-476cc8930a12 service nova] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1fbe0d73-e5e4-4c06-bbce-20b9599a925c req-092745e5-0861-4492-8210-476cc8930a12 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1fbe0d73-e5e4-4c06-bbce-20b9599a925c req-092745e5-0861-4492-8210-476cc8930a12 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-1fbe0d73-e5e4-4c06-bbce-20b9599a925c req-092745e5-0861-4492-8210-476cc8930a12 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] No waiting events found dispatching network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:34 user nova-compute[80928]: WARNING nova.compute.manager [req-1fbe0d73-e5e4-4c06-bbce-20b9599a925c req-092745e5-0861-4492-8210-476cc8930a12 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received unexpected event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 for instance with vm_state active and task_state resize_finish.
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.207s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Successfully created port: 73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk 1073741824" returned: 0 in 0.094s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:34 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Instance running successfully.
Nov 16 05:37:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Failed to set time: agent not configured {{(pid=80928) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea15dcc6-4590-4cae-9b46-3caa044b6564 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] finish_migration finished successfully. {{(pid=80928) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Cannot resize image /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Ensure instance console log exists: /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Successfully updated port: 73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "refresh_cache-310c7fc9-af32-42dd-be30-8460daa03279" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquired lock "refresh_cache-310c7fc9-af32-42dd-be30-8460daa03279" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqmAxsLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:37:35 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:37:35 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:37:35 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[588e4d93-1083-4012-b914-616f5bd3ee2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:37:35 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db9ccd9-937c-4058-b833-eb990dc309f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec] added
Nov 16 05:37:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5610286-39b5-4585-9eba-1adc7346be0a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dbf83f-2b0f-4324-a840-775e552961cc]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqmAxsLg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqmAxsLg" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d3d6a3-776d-44af-b0db-6bffcce45ceb]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jqmAxsLg'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[424e95c0-db4e-47bb-9f62-4685a55221bb]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaef9be-60fb-4dec-a275-e63621c8a452]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Updating instance_info_cache with network_info: [{"id": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "address": "fa:16:3e:0a:4b:f7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73705bd3-4a", "ovs_interfaceid": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Releasing lock "refresh_cache-310c7fc9-af32-42dd-be30-8460daa03279" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Instance network_info: |[{"id": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "address": "fa:16:3e:0a:4b:f7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73705bd3-4a", "ovs_interfaceid": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Start _get_guest_xml network_info=[{"id": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "address": "fa:16:3e:0a:4b:f7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73705bd3-4a", "ovs_interfaceid": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1683a9-5e59-4dcb-9efe-65794ea66879]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec, portal: 172.16.0.220,3260]
Nov 16 05:37:35 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec, portal: 172.16.0.220,3260] successful.
Nov 16 05:37:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:35 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:37:35 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-233322559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-233322559',id=27,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-ugngpnqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:34Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=310c7fc9-af32-42dd-be30-8460daa03279,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "address": "fa:16:3e:0a:4b:f7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73705bd3-4a", "ovs_interfaceid": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "address": "fa:16:3e:0a:4b:f7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73705bd3-4a", "ovs_interfaceid": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4b:f7,bridge_name='br-int',has_traffic_filtering=True,id=73705bd3-4a7a-4430-b6bf-8b71adfac09b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73705bd3-4a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'pci_devices' on Instance uuid 310c7fc9-af32-42dd-be30-8460daa03279 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[57eac4d2-d673-45f5-9154-0e77b9a8dd14]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:37:35 user nova-compute[80928]:   <uuid>310c7fc9-af32-42dd-be30-8460daa03279</uuid>
Nov 16 05:37:35 user nova-compute[80928]:   <name>instance-0000001b</name>
Nov 16 05:37:35 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:37:35 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:37:35 user nova-compute[80928]:   <metadata>
Nov 16 05:37:35 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:37:35 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:37:35 user nova-compute[80928]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-233322559</nova:name>
Nov 16 05:37:35 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:37:35</nova:creationTime>
Nov 16 05:37:35 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:37:35 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:37:35 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:37:35 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:37:35 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:37:35 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:37:35 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:37:35 user nova-compute[80928]:       <nova:owner>
Nov 16 05:37:35 user nova-compute[80928]:         <nova:user uuid="3bb9af29de44488282666171f2bcad47">tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member</nova:user>
Nov 16 05:37:35 user nova-compute[80928]:         <nova:project uuid="995121e71e234f60b7f7d5ac0abcc0f1">tempest-ServerBootFromVolumeStableRescueTest-1026359285</nova:project>
Nov 16 05:37:35 user nova-compute[80928]:       </nova:owner>
Nov 16 05:37:35 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:37:35 user nova-compute[80928]:       <nova:ports>
Nov 16 05:37:35 user nova-compute[80928]:         <nova:port uuid="73705bd3-4a7a-4430-b6bf-8b71adfac09b">
Nov 16 05:37:35 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:37:35 user nova-compute[80928]:         </nova:port>
Nov 16 05:37:35 user nova-compute[80928]:       </nova:ports>
Nov 16 05:37:35 user nova-compute[80928]:     </nova:instance>
Nov 16 05:37:35 user nova-compute[80928]:   </metadata>
Nov 16 05:37:35 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:37:35 user nova-compute[80928]:     <system>
Nov 16 05:37:35 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:37:35 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:37:35 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:37:35 user nova-compute[80928]:       <entry name="serial">310c7fc9-af32-42dd-be30-8460daa03279</entry>
Nov 16 05:37:35 user nova-compute[80928]:       <entry name="uuid">310c7fc9-af32-42dd-be30-8460daa03279</entry>
Nov 16 05:37:35 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:37:35 user nova-compute[80928]:     </system>
Nov 16 05:37:35 user nova-compute[80928]:   </sysinfo>
Nov 16 05:37:35 user nova-compute[80928]:   <os>
Nov 16 05:37:35 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:37:35 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:37:35 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:37:35 user nova-compute[80928]:   </os>
Nov 16 05:37:35 user nova-compute[80928]:   <features>
Nov 16 05:37:35 user nova-compute[80928]:     <acpi/>
Nov 16 05:37:35 user nova-compute[80928]:     <apic/>
Nov 16 05:37:35 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:37:35 user nova-compute[80928]:   </features>
Nov 16 05:37:35 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:37:35 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:37:35 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:37:35 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:37:35 user nova-compute[80928]:   </clock>
Nov 16 05:37:35 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:37:35 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:37:35 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:37:35 user nova-compute[80928]:   </cpu>
Nov 16 05:37:35 user nova-compute[80928]:   <devices>
Nov 16 05:37:35 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:37:35 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:37:35 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk"/>
Nov 16 05:37:35 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:37:35 user nova-compute[80928]:     </disk>
Nov 16 05:37:35 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:37:35 user nova-compute[80928]:       <mac address="fa:16:3e:0a:4b:f7"/>
Nov 16 05:37:35 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:37:35 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:37:35 user nova-compute[80928]:       <target dev="tap73705bd3-4a"/>
Nov 16 05:37:35 user nova-compute[80928]:     </interface>
Nov 16 05:37:35 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:37:35 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/console.log" append="off"/>
Nov 16 05:37:35 user nova-compute[80928]:     </serial>
Nov 16 05:37:35 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:37:35 user nova-compute[80928]:     <video>
Nov 16 05:37:35 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:37:35 user nova-compute[80928]:     </video>
Nov 16 05:37:35 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:37:35 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:37:35 user nova-compute[80928]:     </rng>
Nov 16 05:37:35 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:37:35 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:37:35 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:37:35 user nova-compute[80928]:     </memballoon>
Nov 16 05:37:35 user nova-compute[80928]:   </devices>
Nov 16 05:37:35 user nova-compute[80928]: </domain>
Nov 16 05:37:35 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-233322559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-233322559',id=27,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-ugngpnqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:34Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=310c7fc9-af32-42dd-be30-8460daa03279,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "address": "fa:16:3e:0a:4b:f7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73705bd3-4a", "ovs_interfaceid": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "address": "fa:16:3e:0a:4b:f7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73705bd3-4a", "ovs_interfaceid": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4b:f7,bridge_name='br-int',has_traffic_filtering=True,id=73705bd3-4a7a-4430-b6bf-8b71adfac09b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73705bd3-4a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_vif [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4b:f7,bridge_name='br-int',has_traffic_filtering=True,id=73705bd3-4a7a-4430-b6bf-8b71adfac09b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73705bd3-4a') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e691470-8b6a-5952-962e-350675bd34a4', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5149bf1a-2a66-4680-80bc-b6a5b73d8479]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec (non-flash)
Nov 16 05:37:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:37:35 user nova-compute[80928]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec (non-flash)
Nov 16 05:37:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.469s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73705bd3-4a, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73705bd3-4a, col_values=(('qos', UUID('814c330d-0276-465c-a2ba-bac4067a9b8e')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73705bd3-4a, col_values=(('external_ids', {'iface-id': '73705bd3-4a7a-4430-b6bf-8b71adfac09b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:4b:f7', 'vm-uuid': '310c7fc9-af32-42dd-be30-8460daa03279'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:35 user nova-compute[80928]: INFO os_vif [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4b:f7,bridge_name='br-int',has_traffic_filtering=True,id=73705bd3-4a7a-4430-b6bf-8b71adfac09b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73705bd3-4a')
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.038s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4644a0-38fc-4bf2-9815-d331498dfe5f]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqmAxsLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:37:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No VIF found with MAC fa:16:3e:0a:4b:f7, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG nova.compute.manager [req-b4a3f409-1b4f-42ef-b7e9-98c462b2f82f req-0ad50e9c-a2e2-44f9-b5f3-341aeb99c151 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Received event network-changed-73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG nova.compute.manager [req-b4a3f409-1b4f-42ef-b7e9-98c462b2f82f req-0ad50e9c-a2e2-44f9-b5f3-341aeb99c151 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Refreshing instance network info cache due to event network-changed-73705bd3-4a7a-4430-b6bf-8b71adfac09b. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b4a3f409-1b4f-42ef-b7e9-98c462b2f82f req-0ad50e9c-a2e2-44f9-b5f3-341aeb99c151 service nova] Acquiring lock "refresh_cache-310c7fc9-af32-42dd-be30-8460daa03279" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b4a3f409-1b4f-42ef-b7e9-98c462b2f82f req-0ad50e9c-a2e2-44f9-b5f3-341aeb99c151 service nova] Acquired lock "refresh_cache-310c7fc9-af32-42dd-be30-8460daa03279" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG nova.network.neutron [req-b4a3f409-1b4f-42ef-b7e9-98c462b2f82f req-0ad50e9c-a2e2-44f9-b5f3-341aeb99c151 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Refreshing network info cache for port 73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG nova.network.neutron [req-b4a3f409-1b4f-42ef-b7e9-98c462b2f82f req-0ad50e9c-a2e2-44f9-b5f3-341aeb99c151 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Updated VIF entry in instance network info cache for port 73705bd3-4a7a-4430-b6bf-8b71adfac09b. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG nova.network.neutron [req-b4a3f409-1b4f-42ef-b7e9-98c462b2f82f req-0ad50e9c-a2e2-44f9-b5f3-341aeb99c151 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Updating instance_info_cache with network_info: [{"id": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "address": "fa:16:3e:0a:4b:f7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73705bd3-4a", "ovs_interfaceid": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b4a3f409-1b4f-42ef-b7e9-98c462b2f82f req-0ad50e9c-a2e2-44f9-b5f3-341aeb99c151 service nova] Releasing lock "refresh_cache-310c7fc9-af32-42dd-be30-8460daa03279" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.542s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] <== connect_volume: return (1545ms) {'type': 'block', 'scsi_wwn': '23735373736666531', 'path': '/dev/sdf'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735373736666531', 'path': '/dev/sdf'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG nova.objects.instance [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'flavor' on Instance uuid 9b3672c1-d287-4caa-b022-aa088d51b97a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:37:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:37:36 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:37:36 user nova-compute[80928]:   <source dev="/dev/sdf"/>
Nov 16 05:37:36 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:37:36 user nova-compute[80928]:   <serial>ce768e16-309a-4f17-a51c-e7fbf97803ec</serial>
Nov 16 05:37:36 user nova-compute[80928]: </disk>
Nov 16 05:37:36 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:37:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:37:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:37:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No VIF found with MAC fa:16:3e:f0:11:e0, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:37:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5570f468-7698-45c7-ae5f-325fcea20258 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.976s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-6cf24e2f-befc-44e8-8261-548c945f3890 req-e177adf8-ca43-47af-b62e-a64aac1917b9 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Received event network-vif-plugged-73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6cf24e2f-befc-44e8-8261-548c945f3890 req-e177adf8-ca43-47af-b62e-a64aac1917b9 service nova] Acquiring lock "310c7fc9-af32-42dd-be30-8460daa03279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6cf24e2f-befc-44e8-8261-548c945f3890 req-e177adf8-ca43-47af-b62e-a64aac1917b9 service nova] Lock "310c7fc9-af32-42dd-be30-8460daa03279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6cf24e2f-befc-44e8-8261-548c945f3890 req-e177adf8-ca43-47af-b62e-a64aac1917b9 service nova] Lock "310c7fc9-af32-42dd-be30-8460daa03279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-6cf24e2f-befc-44e8-8261-548c945f3890 req-e177adf8-ca43-47af-b62e-a64aac1917b9 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] No waiting events found dispatching network-vif-plugged-73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:38 user nova-compute[80928]: WARNING nova.compute.manager [req-6cf24e2f-befc-44e8-8261-548c945f3890 req-e177adf8-ca43-47af-b62e-a64aac1917b9 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Received unexpected event network-vif-plugged-73705bd3-4a7a-4430-b6bf-8b71adfac09b for instance with vm_state building and task_state spawning.
Nov 16 05:37:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "9b3672c1-d287-4caa-b022-aa088d51b97a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:39 user nova-compute[80928]: INFO nova.compute.manager [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Detaching volume ce768e16-309a-4f17-a51c-e7fbf97803ec
Nov 16 05:37:39 user nova-compute[80928]: INFO nova.virt.block_device [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Attempting to driver detach volume ce768e16-309a-4f17-a51c-e7fbf97803ec from mountpoint /dev/vdb
Nov 16 05:37:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Attempting to detach device vdb from instance 9b3672c1-d287-4caa-b022-aa088d51b97a from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:37:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:37:39 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:37:39 user nova-compute[80928]:   <source dev="/dev/sdf"/>
Nov 16 05:37:39 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:37:39 user nova-compute[80928]:   <serial>ce768e16-309a-4f17-a51c-e7fbf97803ec</serial>
Nov 16 05:37:39 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:37:39 user nova-compute[80928]: </disk>
Nov 16 05:37:39 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:37:39 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully detached device vdb from instance 9b3672c1-d287-4caa-b022-aa088d51b97a from the persistent domain config.
Nov 16 05:37:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b3672c1-d287-4caa-b022-aa088d51b97a from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:37:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:37:39 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:37:39 user nova-compute[80928]:   <source dev="/dev/sdf"/>
Nov 16 05:37:39 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:37:39 user nova-compute[80928]:   <serial>ce768e16-309a-4f17-a51c-e7fbf97803ec</serial>
Nov 16 05:37:39 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:37:39 user nova-compute[80928]: </disk>
Nov 16 05:37:39 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b3672c1-d287-4caa-b022-aa088d51b97a {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-f0b29667-63be-41ec-9e93-b89748ea32c9 req-c7c58ae1-3942-460a-95f3-3d92548e732a service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Received event network-vif-plugged-73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f0b29667-63be-41ec-9e93-b89748ea32c9 req-c7c58ae1-3942-460a-95f3-3d92548e732a service nova] Acquiring lock "310c7fc9-af32-42dd-be30-8460daa03279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f0b29667-63be-41ec-9e93-b89748ea32c9 req-c7c58ae1-3942-460a-95f3-3d92548e732a service nova] Lock "310c7fc9-af32-42dd-be30-8460daa03279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f0b29667-63be-41ec-9e93-b89748ea32c9 req-c7c58ae1-3942-460a-95f3-3d92548e732a service nova] Lock "310c7fc9-af32-42dd-be30-8460daa03279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-f0b29667-63be-41ec-9e93-b89748ea32c9 req-c7c58ae1-3942-460a-95f3-3d92548e732a service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] No waiting events found dispatching network-vif-plugged-73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:40 user nova-compute[80928]: WARNING nova.compute.manager [req-f0b29667-63be-41ec-9e93-b89748ea32c9 req-c7c58ae1-3942-460a-95f3-3d92548e732a service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Received unexpected event network-vif-plugged-73705bd3-4a7a-4430-b6bf-8b71adfac09b for instance with vm_state building and task_state spawning.
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:37:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Instance spawned successfully.
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:37:40 user nova-compute[80928]: INFO nova.compute.manager [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 16 05:37:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:37:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:40 user nova-compute[80928]: INFO nova.compute.manager [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Took 8.19 seconds to build instance.
Nov 16 05:37:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c92e3ea9-e393-4ae0-abd3-c7813b5f4cde tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "310c7fc9-af32-42dd-be30-8460daa03279" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.366s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:41 user nova-compute[80928]: INFO nova.compute.manager [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Detaching volume 5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:37:41 user nova-compute[80928]: INFO nova.virt.block_device [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Attempting to driver detach volume 5ca704f9-941d-4088-80bc-d998989f18c0 from mountpoint /dev/vdb
Nov 16 05:37:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Attempting to detach device vdb from instance 859f06da-737e-40c3-9e85-2fd33052a9ea from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:37:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:37:41 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:37:41 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:37:41 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:37:41 user nova-compute[80928]:   <serial>5ca704f9-941d-4088-80bc-d998989f18c0</serial>
Nov 16 05:37:41 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 05:37:41 user nova-compute[80928]: </disk>
Nov 16 05:37:41 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:37:41 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully detached device vdb from instance 859f06da-737e-40c3-9e85-2fd33052a9ea from the persistent domain config.
Nov 16 05:37:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 859f06da-737e-40c3-9e85-2fd33052a9ea from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:37:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:37:41 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:37:41 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:37:41 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:37:41 user nova-compute[80928]:   <serial>5ca704f9-941d-4088-80bc-d998989f18c0</serial>
Nov 16 05:37:41 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 05:37:41 user nova-compute[80928]: </disk>
Nov 16 05:37:41 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 859f06da-737e-40c3-9e85-2fd33052a9ea {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "5d03bda0-20b8-497a-a87b-faee21624468" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "5d03bda0-20b8-497a-a87b-faee21624468" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "5d03bda0-20b8-497a-a87b-faee21624468-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "5d03bda0-20b8-497a-a87b-faee21624468-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "5d03bda0-20b8-497a-a87b-faee21624468-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:42 user nova-compute[80928]: INFO nova.compute.manager [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Terminating instance
Nov 16 05:37:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-5337c06c-919d-4180-9cb5-2edf6229cf02 req-acd06f24-ad55-4b72-b6e2-5ae2ebbf869d service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Received event network-vif-unplugged-7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5337c06c-919d-4180-9cb5-2edf6229cf02 req-acd06f24-ad55-4b72-b6e2-5ae2ebbf869d service nova] Acquiring lock "5d03bda0-20b8-497a-a87b-faee21624468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5337c06c-919d-4180-9cb5-2edf6229cf02 req-acd06f24-ad55-4b72-b6e2-5ae2ebbf869d service nova] Lock "5d03bda0-20b8-497a-a87b-faee21624468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5337c06c-919d-4180-9cb5-2edf6229cf02 req-acd06f24-ad55-4b72-b6e2-5ae2ebbf869d service nova] Lock "5d03bda0-20b8-497a-a87b-faee21624468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-5337c06c-919d-4180-9cb5-2edf6229cf02 req-acd06f24-ad55-4b72-b6e2-5ae2ebbf869d service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] No waiting events found dispatching network-vif-unplugged-7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-5337c06c-919d-4180-9cb5-2edf6229cf02 req-acd06f24-ad55-4b72-b6e2-5ae2ebbf869d service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Received event network-vif-unplugged-7af67efa-d198-4abd-bbdf-a73cf48b7c43 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:37:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:43 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Instance destroyed successfully.
Nov 16 05:37:43 user nova-compute[80928]: DEBUG nova.objects.instance [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lazy-loading 'resources' on Instance uuid 5d03bda0-20b8-497a-a87b-faee21624468 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1710517253',display_name='tempest-ServersNegativeTestJSON-server-1710517253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1710517253',id=2,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b31a972c7cdc45e79d788c35ac613b0e',ramdisk_id='',reservation_id='r-0s5yddcg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1596712159',owner_user_name='tempest-ServersNegativeTestJSON-1596712159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:29:17Z,user_data=None,user_id='b904db715308497cbd24bfd51a34d0f9',uuid=5d03bda0-20b8-497a-a87b-faee21624468,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "address": "fa:16:3e:57:d0:dd", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af67efa-d1", "ovs_interfaceid": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Converting VIF {"id": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "address": "fa:16:3e:57:d0:dd", "network": {"id": "ec763030-28e9-4f7e-a78f-155dd149b110", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1790551219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b31a972c7cdc45e79d788c35ac613b0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af67efa-d1", "ovs_interfaceid": "7af67efa-d198-4abd-bbdf-a73cf48b7c43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:d0:dd,bridge_name='br-int',has_traffic_filtering=True,id=7af67efa-d198-4abd-bbdf-a73cf48b7c43,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af67efa-d1') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG os_vif [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:d0:dd,bridge_name='br-int',has_traffic_filtering=True,id=7af67efa-d198-4abd-bbdf-a73cf48b7c43,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af67efa-d1') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7af67efa-d1, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20d58b59-7c0e-4070-849a-d79c9ec1c4f9) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:43 user nova-compute[80928]: INFO os_vif [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:d0:dd,bridge_name='br-int',has_traffic_filtering=True,id=7af67efa-d198-4abd-bbdf-a73cf48b7c43,network=Network(ec763030-28e9-4f7e-a78f-155dd149b110),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af67efa-d1')
Nov 16 05:37:43 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Deleting instance files /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468_del
Nov 16 05:37:43 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Deletion of /opt/stack/data/nova/instances/5d03bda0-20b8-497a-a87b-faee21624468_del complete
Nov 16 05:37:43 user nova-compute[80928]: INFO nova.compute.manager [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 16 05:37:43 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:43 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Took 0.48 seconds to deallocate network for instance.
Nov 16 05:37:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:44 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:37:44 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:37:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:44 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Deleted allocations for instance 5d03bda0-20b8-497a-a87b-faee21624468
Nov 16 05:37:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55392d71-b148-4b1f-b67c-03e79f570de1 tempest-ServersNegativeTestJSON-1596712159 tempest-ServersNegativeTestJSON-1596712159-project-member] Lock "5d03bda0-20b8-497a-a87b-faee21624468" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.204s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-bd161694-c927-4173-97e9-5c5325a67d7d req-a5cf9cfd-e0ca-49b9-93cb-b99794f8792d service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Received event network-vif-plugged-7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd161694-c927-4173-97e9-5c5325a67d7d req-a5cf9cfd-e0ca-49b9-93cb-b99794f8792d service nova] Acquiring lock "5d03bda0-20b8-497a-a87b-faee21624468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd161694-c927-4173-97e9-5c5325a67d7d req-a5cf9cfd-e0ca-49b9-93cb-b99794f8792d service nova] Lock "5d03bda0-20b8-497a-a87b-faee21624468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bd161694-c927-4173-97e9-5c5325a67d7d req-a5cf9cfd-e0ca-49b9-93cb-b99794f8792d service nova] Lock "5d03bda0-20b8-497a-a87b-faee21624468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-bd161694-c927-4173-97e9-5c5325a67d7d req-a5cf9cfd-e0ca-49b9-93cb-b99794f8792d service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] No waiting events found dispatching network-vif-plugged-7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:44 user nova-compute[80928]: WARNING nova.compute.manager [req-bd161694-c927-4173-97e9-5c5325a67d7d req-a5cf9cfd-e0ca-49b9-93cb-b99794f8792d service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Received unexpected event network-vif-plugged-7af67efa-d198-4abd-bbdf-a73cf48b7c43 for instance with vm_state deleted and task_state None.
Nov 16 05:37:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-bd161694-c927-4173-97e9-5c5325a67d7d req-a5cf9cfd-e0ca-49b9-93cb-b99794f8792d service nova] [instance: 5d03bda0-20b8-497a-a87b-faee21624468] Received event network-vif-deleted-7af67efa-d198-4abd-bbdf-a73cf48b7c43 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:47 user nova-compute[80928]: INFO nova.compute.manager [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Terminating instance
Nov 16 05:37:47 user nova-compute[80928]: DEBUG nova.compute.manager [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-0b6c4e13-1632-411c-9e1d-2d44df548cfd req-6342e345-ddb1-44cf-b834-4a095ca4c178 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event network-vif-unplugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0b6c4e13-1632-411c-9e1d-2d44df548cfd req-6342e345-ddb1-44cf-b834-4a095ca4c178 service nova] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0b6c4e13-1632-411c-9e1d-2d44df548cfd req-6342e345-ddb1-44cf-b834-4a095ca4c178 service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0b6c4e13-1632-411c-9e1d-2d44df548cfd req-6342e345-ddb1-44cf-b834-4a095ca4c178 service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-0b6c4e13-1632-411c-9e1d-2d44df548cfd req-6342e345-ddb1-44cf-b834-4a095ca4c178 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] No waiting events found dispatching network-vif-unplugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-0b6c4e13-1632-411c-9e1d-2d44df548cfd req-6342e345-ddb1-44cf-b834-4a095ca4c178 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event network-vif-unplugged-4acbefc0-9505-48d7-9718-581771fcd450 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:37:47 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Instance destroyed successfully.
Nov 16 05:37:47 user nova-compute[80928]: DEBUG nova.objects.instance [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lazy-loading 'resources' on Instance uuid b0211dc5-730f-435b-8d39-3a1606a7696f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1081583894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1342069825',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrww7sI55a3Trl1PjEiEIP4wlwDIEoLgs3TLCjEDtdyvuCgUJTQf3YJE0l8HAZq4ews1teuYYbO2FrUVPNoHQVhYuYAl1+w8B/UHR4F7VdE+bpMzQtOmJVEPqskAogcEg==',key_name='tempest-keypair-1036640328',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:36:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dde93358753b405293c50a4eb65a55a8',ramdisk_id='',reservation_id='r-bx9ws9wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1532463154',owner_user_name='tempest-ServerActionsV293TestJSON-1532463154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:36:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce09fc1320c4033baf06caf7282676a',uuid=b0211dc5-730f-435b-8d39-3a1606a7696f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Converting VIF {"id": "4acbefc0-9505-48d7-9718-581771fcd450", "address": "fa:16:3e:4b:36:0b", "network": {"id": "b04b7f22-33df-42db-a3e0-23f10f9ba514", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2089750408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dde93358753b405293c50a4eb65a55a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4acbefc0-95", "ovs_interfaceid": "4acbefc0-9505-48d7-9718-581771fcd450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG os_vif [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4acbefc0-95, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bda605a1-6f3a-4c55-b94c-62fa33033030) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:47 user nova-compute[80928]: INFO os_vif [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:36:0b,bridge_name='br-int',has_traffic_filtering=True,id=4acbefc0-9505-48d7-9718-581771fcd450,network=Network(b04b7f22-33df-42db-a3e0-23f10f9ba514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4acbefc0-95')
Nov 16 05:37:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjFwbycI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:37:47 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:37:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b4aba6-65f7-4753-a3c2-0a618600dcdb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:37:47 user nova-compute[80928]: No targets found.
Nov 16 05:37:47 user nova-compute[80928]: iSNS:
Nov 16 05:37:47 user nova-compute[80928]: No targets found.
Nov 16 05:37:47 user nova-compute[80928]: STATIC:
Nov 16 05:37:47 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:37:47 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:37:47 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:37:47 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13
Nov 16 05:37:47 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:37:47 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:37:47 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec
Nov 16 05:37:47 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:37:47 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:37:47 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890
Nov 16 05:37:47 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:37:47 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:37:47 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7
Nov 16 05:37:47 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:37:47 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:37:47 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:37:47 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:37:47 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:37:47 user nova-compute[80928]: FIRMWARE:
Nov 16 05:37:47 user nova-compute[80928]: No targets found.
Nov 16 05:37:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:37:47 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:37:47 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7226ea1-2ad6-42f8-8626-42daa041a24b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c395fc0d-506b-4da5-a656-4bd1b50eea6f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:47 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:47 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:47 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:47 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:37:47 user nova-compute[80928]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec (non-flash)
Nov 16 05:37:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:37:47 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:37:47 user nova-compute[80928]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 (non-flash)
Nov 16 05:37:47 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:37:47 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:37:47 user nova-compute[80928]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec (non-flash)
Nov 16 05:37:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8658363e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:37:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[957ef638-8aad-4b51-9e44-53eb5e8a1390]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f80be65-e0e1-4432-8f06-8d268a453cf3]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d7276a-9ee2-4ab3-91fb-9fb474194502]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[40949c5c-3adf-466e-a055-9bdf643bf102]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_99113499', '/dev/disk/by-id/scsi-1SCST_BIO99113499-37d7264291653b70', '/dev/disk/by-id/scsi-23337643732363432') {{(pid=92262) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd8bf06-2469-475a-85b8-f1b3d4519a06]: (4, None) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de628ea-3ca9-4900-8412-f81edb0190d4]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[476611b4-d4b4-4506-b408-28458748a3be]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260]
Nov 16 05:37:48 user nova-compute[80928]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7, portal: 172.16.0.220,3260] successful.
Nov 16 05:37:48 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4c943-129b-442f-89c6-7923123c3ed7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6954f54c-b30b-4748-ace6-9395b5c5600f]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] <== disconnect_volume: return (368ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:37:48 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Deleting instance files /opt/stack/data/nova/instances/b0211dc5-730f-435b-8d39-3a1606a7696f_del
Nov 16 05:37:48 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Deletion of /opt/stack/data/nova/instances/b0211dc5-730f-435b-8d39-3a1606a7696f_del complete
Nov 16 05:37:48 user nova-compute[80928]: INFO nova.compute.manager [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 16 05:37:48 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:37:48 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:37:49 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:49 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Took 1.04 seconds to deallocate network for instance.
Nov 16 05:37:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-930880a4-de3a-4664-9d67-16f448a83746 req-5d82d2d1-b8dd-404b-a539-6cac0f1a777a service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event network-vif-deleted-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:49 user nova-compute[80928]: INFO nova.compute.manager [req-930880a4-de3a-4664-9d67-16f448a83746 req-5d82d2d1-b8dd-404b-a539-6cac0f1a777a service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Neutron deleted interface 4acbefc0-9505-48d7-9718-581771fcd450; detaching it from the instance and deleting it from the info cache
Nov 16 05:37:49 user nova-compute[80928]: DEBUG nova.network.neutron [req-930880a4-de3a-4664-9d67-16f448a83746 req-5d82d2d1-b8dd-404b-a539-6cac0f1a777a service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:37:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-930880a4-de3a-4664-9d67-16f448a83746 req-5d82d2d1-b8dd-404b-a539-6cac0f1a777a service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Detach interface failed, port_id=4acbefc0-9505-48d7-9718-581771fcd450, reason: Instance b0211dc5-730f-435b-8d39-3a1606a7696f could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:37:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-b97f6cbc-e461-4675-adee-267063cfd748 req-b33070ed-4451-419d-aff9-85e99f87f6c0 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received event network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:37:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b97f6cbc-e461-4675-adee-267063cfd748 req-b33070ed-4451-419d-aff9-85e99f87f6c0 service nova] Acquiring lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b97f6cbc-e461-4675-adee-267063cfd748 req-b33070ed-4451-419d-aff9-85e99f87f6c0 service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b97f6cbc-e461-4675-adee-267063cfd748 req-b33070ed-4451-419d-aff9-85e99f87f6c0 service nova] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-b97f6cbc-e461-4675-adee-267063cfd748 req-b33070ed-4451-419d-aff9-85e99f87f6c0 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] No waiting events found dispatching network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:37:49 user nova-compute[80928]: WARNING nova.compute.manager [req-b97f6cbc-e461-4675-adee-267063cfd748 req-b33070ed-4451-419d-aff9-85e99f87f6c0 service nova] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Received unexpected event network-vif-plugged-4acbefc0-9505-48d7-9718-581771fcd450 for instance with vm_state active and task_state deleting.
Nov 16 05:37:50 user nova-compute[80928]: INFO nova.compute.manager [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Took 1.01 seconds to detach 1 volumes for instance.
Nov 16 05:37:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] [instance: b0211dc5-730f-435b-8d39-3a1606a7696f] Deleting volume: 35e4c943-129b-442f-89c6-7923123c3ed7 {{(pid=80928) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 05:37:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:50 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:37:50 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:37:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:50 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Deleted allocations for instance b0211dc5-730f-435b-8d39-3a1606a7696f
Nov 16 05:37:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-042d1342-667a-498e-8385-21650bde532d tempest-ServerActionsV293TestJSON-1532463154 tempest-ServerActionsV293TestJSON-1532463154-project-member] Lock "b0211dc5-730f-435b-8d39-3a1606a7696f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.044s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:55 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:37:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:37:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:37:59 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:37:59 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:37:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:37:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:37:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:37:59 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:37:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:37:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b3672c1-d287-4caa-b022-aa088d51b97a is timed out.
Nov 16 05:38:00 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully detached device vdb from instance 9b3672c1-d287-4caa-b022-aa088d51b97a from the live domain config.
Nov 16 05:38:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqmAxsLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:38:00 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d286f72-34bc-4e08-88c2-0bad377bf2f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:38:00 user nova-compute[80928]: No targets found.
Nov 16 05:38:00 user nova-compute[80928]: iSNS:
Nov 16 05:38:00 user nova-compute[80928]: No targets found.
Nov 16 05:38:00 user nova-compute[80928]: STATIC:
Nov 16 05:38:00 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:38:00 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:38:00 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:38:00 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13
Nov 16 05:38:00 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:38:00 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:38:00 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec
Nov 16 05:38:00 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:38:00 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:38:00 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890
Nov 16 05:38:00 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:38:00 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:38:00 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:38:00 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:38:00 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:38:00 user nova-compute[80928]: FIRMWARE:
Nov 16 05:38:00 user nova-compute[80928]: No targets found.
Nov 16 05:38:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:38:00 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:38:00 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e763c4-2d46-497d-988c-9808d6c61f85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[05790718-9222-4fe9-938e-968e42f4ae49]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:38:00 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:38:00 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:38:00 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:38:00 user nova-compute[80928]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec (non-flash)
Nov 16 05:38:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:38:00 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:38:00 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:38:00 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:38:00 user nova-compute[80928]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec (non-flash)
Nov 16 05:38:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8658438af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec'): ({'sdf'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Removing single pathed devices sdf {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08c2543-43e0-45d8-9e5d-4a0bd961e775]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de0ee94-e38b-41fb-ac4e-1dc3a2e3378e]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Flushing IO for device /dev/sdf {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58bcb64-6a03-4376-b578-e6b96efad2e8]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2249f2-ff78-4d6c-b974-34b9cb23d1fc]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] SCSI volumes sdf have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc3cba6-4071-4b01-8c35-9b6aaebb30b4]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[580c977e-d531-4943-ba33-350454f2914d]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec, portal: 172.16.0.220,3260]
Nov 16 05:38:00 user nova-compute[80928]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec, portal: 172.16.0.220,3260] successful.
Nov 16 05:38:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce768e16-309a-4f17-a51c-e7fbf97803ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e54b9d-bfeb-43e4-8d6a-77c33b4ae209]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] <== disconnect_volume: return (388ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'flavor' on Instance uuid 9b3672c1-d287-4caa-b022-aa088d51b97a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c0916dd8-ce16-46ce-bbe1-c3a2bed75c8c tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.926s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:38:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 859f06da-737e-40c3-9e85-2fd33052a9ea is timed out.
Nov 16 05:38:02 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully detached device vdb from instance 859f06da-737e-40c3-9e85-2fd33052a9ea from the live domain config.
Nov 16 05:38:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSJdlrqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:38:02 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a7790b-b980-448e-a814-eaa4499409a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:38:02 user nova-compute[80928]: No targets found.
Nov 16 05:38:02 user nova-compute[80928]: iSNS:
Nov 16 05:38:02 user nova-compute[80928]: No targets found.
Nov 16 05:38:02 user nova-compute[80928]: STATIC:
Nov 16 05:38:02 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0
Nov 16 05:38:02 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:38:02 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:38:02 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13
Nov 16 05:38:02 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:38:02 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:38:02 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890
Nov 16 05:38:02 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:38:02 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:38:02 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:38:02 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:38:02 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:38:02 user nova-compute[80928]: FIRMWARE:
Nov 16 05:38:02 user nova-compute[80928]: No targets found.
Nov 16 05:38:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:38:02 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:38:02 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5a102b-c6a7-4881-bf3d-5e1323e6fc49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[adabed58-af20-43d0-9ac6-1da6e0d54033]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:38:02 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:38:02 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:38:02 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:38:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:38:02 user nova-compute[80928]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 (non-flash)
Nov 16 05:38:02 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:38:02 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:38:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0'): ({'sdd'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Removing single pathed devices sdd {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[542bf830-4887-4e51-bb7f-60849c7fb76c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6eee2d-beec-4dd2-a041-749636e7129d]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flushing IO for device /dev/sdd {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a0b789-6b8b-4ad9-b569-acd52509b286]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[47abf6c7-80ec-4632-84ab-6c3bbdbbb530]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[92beaf9c-b9d1-4b93-ac08-ff9bb2e961da]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e66af4a-3efe-422d-81a8-85bf24fca8a5]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260]
Nov 16 05:38:02 user nova-compute[80928]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0, portal: 172.16.0.220,3260] successful.
Nov 16 05:38:02 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca704f9-941d-4088-80bc-d998989f18c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a31b8cd-734b-4189-b0f7-02ebfa6bf27a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== disconnect_volume: return (359ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG nova.objects.instance [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lazy-loading 'flavor' on Instance uuid 859f06da-737e-40c3-9e85-2fd33052a9ea {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5a4f5b8c-a7d2-4873-9648-7dc69323e621 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.846s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:04 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:38:04 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7024MB free_disk=25.30721664428711GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Applying migration context for instance 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc as it has an incoming, in-progress migration 7d993896-ad98-4861-aac2-d9e3321576f7. Migration status is finished {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 05:38:04 user nova-compute[80928]: INFO nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating resource usage from migration 7d993896-ad98-4861-aac2-d9e3321576f7
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 859f06da-737e-40c3-9e85-2fd33052a9ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 9b3672c1-d287-4caa-b022-aa088d51b97a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance c5ae2c42-de68-4619-96a1-643755597b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 1d95a79b-847f-4eba-a096-65c834f94a40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Migration 7d993896-ad98-4861-aac2-d9e3321576f7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 3255dd8b-2060-470f-a4bb-08594977342e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 310c7fc9-af32-42dd-be30-8460daa03279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:38:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:38:05 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:38:05 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:38:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:38:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-7272425c-c1c0-47d4-afcd-b0ad5fc8d2bc req-167ab203-26ec-4d81-9338-5d36bcec761b service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-changed-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-7272425c-c1c0-47d4-afcd-b0ad5fc8d2bc req-167ab203-26ec-4d81-9338-5d36bcec761b service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Refreshing instance network info cache due to event network-changed-c5104be0-b766-4a44-807e-b82c40dadbd7. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7272425c-c1c0-47d4-afcd-b0ad5fc8d2bc req-167ab203-26ec-4d81-9338-5d36bcec761b service nova] Acquiring lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7272425c-c1c0-47d4-afcd-b0ad5fc8d2bc req-167ab203-26ec-4d81-9338-5d36bcec761b service nova] Acquired lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-7272425c-c1c0-47d4-afcd-b0ad5fc8d2bc req-167ab203-26ec-4d81-9338-5d36bcec761b service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Refreshing network info cache for port c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updating instance_info_cache with network_info: [{"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:38:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:38:07 user nova-compute[80928]: DEBUG nova.network.neutron [req-7272425c-c1c0-47d4-afcd-b0ad5fc8d2bc req-167ab203-26ec-4d81-9338-5d36bcec761b service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updated VIF entry in instance network info cache for port c5104be0-b766-4a44-807e-b82c40dadbd7. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:38:07 user nova-compute[80928]: DEBUG nova.network.neutron [req-7272425c-c1c0-47d4-afcd-b0ad5fc8d2bc req-167ab203-26ec-4d81-9338-5d36bcec761b service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updating instance_info_cache with network_info: [{"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:38:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7272425c-c1c0-47d4-afcd-b0ad5fc8d2bc req-167ab203-26ec-4d81-9338-5d36bcec761b service nova] Releasing lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:38:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:38:07 user nova-compute[80928]: INFO nova.compute.manager [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] instance snapshotting
Nov 16 05:38:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Beginning live snapshot process
Nov 16 05:38:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json -f qcow2 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json -f qcow2 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf4x9f9cc/e77de2c56de046bf91d3912be3f368dd.delta 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf4x9f9cc/e77de2c56de046bf91d3912be3f368dd.delta 1073741824" returned: 0 in 0.048s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:08 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 05:38:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] COPY block job progress, current cursor: 131072 final cursor: 75497472 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:38:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:38:09 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 05:38:09 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:38:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf4x9f9cc/e77de2c56de046bf91d3912be3f368dd.delta /opt/stack/data/nova/instances/snapshots/tmpf4x9f9cc/e77de2c56de046bf91d3912be3f368dd {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf4x9f9cc/e77de2c56de046bf91d3912be3f368dd.delta /opt/stack/data/nova/instances/snapshots/tmpf4x9f9cc/e77de2c56de046bf91d3912be3f368dd" returned: 0 in 0.360s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:10 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Snapshot extracted, beginning image upload
Nov 16 05:38:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:13 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Snapshot image upload complete
Nov 16 05:38:13 user nova-compute[80928]: INFO nova.compute.manager [None req-c98f82eb-d7c0-4e9c-a7e2-11fcda9ec1c8 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Took 5.55 seconds to snapshot the instance on the hypervisor.
Nov 16 05:38:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "9b3672c1-d287-4caa-b022-aa088d51b97a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:38:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:38:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:38:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:38:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:29 user nova-compute[80928]: INFO nova.compute.manager [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Terminating instance
Nov 16 05:38:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:38:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-debc5c9c-9966-4f23-9ad8-90ea3a981e60 req-23ac9c4f-05a8-47b8-b74d-7f6c115605d8 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Received event network-vif-unplugged-bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-debc5c9c-9966-4f23-9ad8-90ea3a981e60 req-23ac9c4f-05a8-47b8-b74d-7f6c115605d8 service nova] Acquiring lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-debc5c9c-9966-4f23-9ad8-90ea3a981e60 req-23ac9c4f-05a8-47b8-b74d-7f6c115605d8 service nova] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-debc5c9c-9966-4f23-9ad8-90ea3a981e60 req-23ac9c4f-05a8-47b8-b74d-7f6c115605d8 service nova] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-debc5c9c-9966-4f23-9ad8-90ea3a981e60 req-23ac9c4f-05a8-47b8-b74d-7f6c115605d8 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] No waiting events found dispatching network-vif-unplugged-bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-debc5c9c-9966-4f23-9ad8-90ea3a981e60 req-23ac9c4f-05a8-47b8-b74d-7f6c115605d8 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Received event network-vif-unplugged-bcb8857b-e339-4e3f-909d-d687fc8481fd for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:30 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Instance destroyed successfully.
Nov 16 05:38:30 user nova-compute[80928]: DEBUG nova.objects.instance [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'resources' on Instance uuid 9b3672c1-d287-4caa-b022-aa088d51b97a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1702849269',display_name='tempest-AttachVolumeNegativeTest-server-1702849269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1702849269',id=22,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc80cj/q5VLkhluo2ro9rFnCF8aTeikgGdq/YF3w7ZNeYuxKF+aSwi0ZeXxP9xjmq5fcH2jiIAvrF/iPzUYWxjaYsiiuvSk6Om13xNLxKA05f8mXVslP4H1vnua6LRllA==',key_name='tempest-keypair-875834071',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f585dcb9e6cb432a9b04526ebc30e9d8',ramdisk_id='',reservation_id='r-g3qew1dv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-155531213',owner_user_name='tempest-AttachVolumeNegativeTest-155531213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952a7ea7e63649259b0b1e0df40c97d0',uuid=9b3672c1-d287-4caa-b022-aa088d51b97a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "address": "fa:16:3e:f0:11:e0", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb8857b-e3", "ovs_interfaceid": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converting VIF {"id": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "address": "fa:16:3e:f0:11:e0", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb8857b-e3", "ovs_interfaceid": "bcb8857b-e339-4e3f-909d-d687fc8481fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:e0,bridge_name='br-int',has_traffic_filtering=True,id=bcb8857b-e339-4e3f-909d-d687fc8481fd,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb8857b-e3') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG os_vif [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:e0,bridge_name='br-int',has_traffic_filtering=True,id=bcb8857b-e339-4e3f-909d-d687fc8481fd,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb8857b-e3') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcb8857b-e3, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=024535d3-b1cd-4544-9af8-c7223871004c) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:38:30 user nova-compute[80928]: INFO os_vif [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:e0,bridge_name='br-int',has_traffic_filtering=True,id=bcb8857b-e339-4e3f-909d-d687fc8481fd,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb8857b-e3')
Nov 16 05:38:30 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Deleting instance files /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a_del
Nov 16 05:38:30 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Deletion of /opt/stack/data/nova/instances/9b3672c1-d287-4caa-b022-aa088d51b97a_del complete
Nov 16 05:38:30 user nova-compute[80928]: INFO nova.compute.manager [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 05:38:30 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:38:30 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:38:31 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:38:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-f39a4880-e56b-4ea1-89d5-af79f7ca4410 req-9bea0ce9-608c-47b6-8fb3-4294cee37c48 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Received event network-vif-deleted-bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:38:31 user nova-compute[80928]: INFO nova.compute.manager [req-f39a4880-e56b-4ea1-89d5-af79f7ca4410 req-9bea0ce9-608c-47b6-8fb3-4294cee37c48 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Neutron deleted interface bcb8857b-e339-4e3f-909d-d687fc8481fd; detaching it from the instance and deleting it from the info cache
Nov 16 05:38:31 user nova-compute[80928]: DEBUG nova.network.neutron [req-f39a4880-e56b-4ea1-89d5-af79f7ca4410 req-9bea0ce9-608c-47b6-8fb3-4294cee37c48 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:38:31 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Took 0.84 seconds to deallocate network for instance.
Nov 16 05:38:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-f39a4880-e56b-4ea1-89d5-af79f7ca4410 req-9bea0ce9-608c-47b6-8fb3-4294cee37c48 service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Detach interface failed, port_id=bcb8857b-e339-4e3f-909d-d687fc8481fd, reason: Instance 9b3672c1-d287-4caa-b022-aa088d51b97a could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:38:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:38:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:38:31 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:38:31 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:32 user nova-compute[80928]: INFO nova.compute.manager [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Terminating instance
Nov 16 05:38:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:38:32 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Deleted allocations for instance 9b3672c1-d287-4caa-b022-aa088d51b97a
Nov 16 05:38:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-aacf46c7-41ff-45fc-9306-de5d6d420a9b req-55605b37-f337-4567-9102-a48c9301293b service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Received event network-vif-plugged-bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aacf46c7-41ff-45fc-9306-de5d6d420a9b req-55605b37-f337-4567-9102-a48c9301293b service nova] Acquiring lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aacf46c7-41ff-45fc-9306-de5d6d420a9b req-55605b37-f337-4567-9102-a48c9301293b service nova] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aacf46c7-41ff-45fc-9306-de5d6d420a9b req-55605b37-f337-4567-9102-a48c9301293b service nova] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-aacf46c7-41ff-45fc-9306-de5d6d420a9b req-55605b37-f337-4567-9102-a48c9301293b service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] No waiting events found dispatching network-vif-plugged-bcb8857b-e339-4e3f-909d-d687fc8481fd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:38:32 user nova-compute[80928]: WARNING nova.compute.manager [req-aacf46c7-41ff-45fc-9306-de5d6d420a9b req-55605b37-f337-4567-9102-a48c9301293b service nova] [instance: 9b3672c1-d287-4caa-b022-aa088d51b97a] Received unexpected event network-vif-plugged-bcb8857b-e339-4e3f-909d-d687fc8481fd for instance with vm_state deleted and task_state None.
Nov 16 05:38:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d1878390-8dc3-4a47-93e2-61990d994d9f tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "9b3672c1-d287-4caa-b022-aa088d51b97a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.504s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:32 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Instance destroyed successfully.
Nov 16 05:38:32 user nova-compute[80928]: DEBUG nova.objects.instance [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lazy-loading 'resources' on Instance uuid 859f06da-737e-40c3-9e85-2fd33052a9ea {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:32:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-33151290',display_name='tempest-ServerActionsTestOtherA-server-12103829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-33151290',id=17,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTVVxLriAse+8lverhdQdhnvii6w45qThd0fHyb5Ol521IcYdHykJ/QxuqMWVLnXJFzh4a6SQNJa6fCD+2a2PXyDp0J+MN8Qy1Dn2CkfQ45KGGkbsS5jLLHLRnfASO6mw==',key_name='tempest-keypair-661491812',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:35:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-p74fir7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:35:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=859f06da-737e-40c3-9e85-2fd33052a9ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "address": "fa:16:3e:b3:20:4d", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap810ff4e6-46", "ovs_interfaceid": "810ff4e6-46ca-448f-ba1c-047dc5db6d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG os_vif [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap810ff4e6-46, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4fff56d-6692-4578-ab29-6d6bd4e92f50) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:38:32 user nova-compute[80928]: INFO os_vif [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:4d,bridge_name='br-int',has_traffic_filtering=True,id=810ff4e6-46ca-448f-ba1c-047dc5db6d75,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap810ff4e6-46')
Nov 16 05:38:32 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Deleting instance files /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea_del
Nov 16 05:38:32 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Deletion of /opt/stack/data/nova/instances/859f06da-737e-40c3-9e85-2fd33052a9ea_del complete
Nov 16 05:38:32 user nova-compute[80928]: INFO nova.compute.manager [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 05:38:32 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:38:32 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "1d95a79b-847f-4eba-a096-65c834f94a40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:38:33 user nova-compute[80928]: INFO nova.compute.manager [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Detaching volume 9379a036-959f-4789-a2e3-723a44580890
Nov 16 05:38:33 user nova-compute[80928]: INFO nova.virt.block_device [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Attempting to driver detach volume 9379a036-959f-4789-a2e3-723a44580890 from mountpoint /dev/vdc
Nov 16 05:38:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Attempting to detach device vdc from instance 1d95a79b-847f-4eba-a096-65c834f94a40 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:38:33 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:38:33 user nova-compute[80928]:   <source dev="/dev/sde"/>
Nov 16 05:38:33 user nova-compute[80928]:   <target dev="vdc" bus="virtio"/>
Nov 16 05:38:33 user nova-compute[80928]:   <serial>9379a036-959f-4789-a2e3-723a44580890</serial>
Nov 16 05:38:33 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 05:38:33 user nova-compute[80928]: </disk>
Nov 16 05:38:33 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:38:33 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Successfully detached device vdc from instance 1d95a79b-847f-4eba-a096-65c834f94a40 from the persistent domain config.
Nov 16 05:38:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1d95a79b-847f-4eba-a096-65c834f94a40 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:38:33 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:38:33 user nova-compute[80928]:   <source dev="/dev/sde"/>
Nov 16 05:38:33 user nova-compute[80928]:   <target dev="vdc" bus="virtio"/>
Nov 16 05:38:33 user nova-compute[80928]:   <serial>9379a036-959f-4789-a2e3-723a44580890</serial>
Nov 16 05:38:33 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 05:38:33 user nova-compute[80928]: </disk>
Nov 16 05:38:33 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-2b35d691-d398-4c7b-af09-7b07d0525f96 req-30a3d7b5-d617-4ffa-997d-4535a1697f3c service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received event network-vif-unplugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2b35d691-d398-4c7b-af09-7b07d0525f96 req-30a3d7b5-d617-4ffa-997d-4535a1697f3c service nova] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2b35d691-d398-4c7b-af09-7b07d0525f96 req-30a3d7b5-d617-4ffa-997d-4535a1697f3c service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2b35d691-d398-4c7b-af09-7b07d0525f96 req-30a3d7b5-d617-4ffa-997d-4535a1697f3c service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-2b35d691-d398-4c7b-af09-7b07d0525f96 req-30a3d7b5-d617-4ffa-997d-4535a1697f3c service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] No waiting events found dispatching network-vif-unplugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-2b35d691-d398-4c7b-af09-7b07d0525f96 req-30a3d7b5-d617-4ffa-997d-4535a1697f3c service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received event network-vif-unplugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-2b35d691-d398-4c7b-af09-7b07d0525f96 req-30a3d7b5-d617-4ffa-997d-4535a1697f3c service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received event network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2b35d691-d398-4c7b-af09-7b07d0525f96 req-30a3d7b5-d617-4ffa-997d-4535a1697f3c service nova] Acquiring lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2b35d691-d398-4c7b-af09-7b07d0525f96 req-30a3d7b5-d617-4ffa-997d-4535a1697f3c service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2b35d691-d398-4c7b-af09-7b07d0525f96 req-30a3d7b5-d617-4ffa-997d-4535a1697f3c service nova] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-2b35d691-d398-4c7b-af09-7b07d0525f96 req-30a3d7b5-d617-4ffa-997d-4535a1697f3c service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] No waiting events found dispatching network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:38:33 user nova-compute[80928]: WARNING nova.compute.manager [req-2b35d691-d398-4c7b-af09-7b07d0525f96 req-30a3d7b5-d617-4ffa-997d-4535a1697f3c service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received unexpected event network-vif-plugged-810ff4e6-46ca-448f-ba1c-047dc5db6d75 for instance with vm_state active and task_state deleting.
Nov 16 05:38:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1d95a79b-847f-4eba-a096-65c834f94a40 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:38:33 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Took 1.02 seconds to deallocate network for instance.
Nov 16 05:38:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:38:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:38:34 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:38:34 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:38:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:34 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Deleted allocations for instance 859f06da-737e-40c3-9e85-2fd33052a9ea
Nov 16 05:38:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aaa857a7-949a-4fb0-b028-4eb2d5cedb05 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "859f06da-737e-40c3-9e85-2fd33052a9ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.517s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-381b8f51-b1bc-4b85-b3ce-c573a2053fce req-061dd7ed-a9d1-4628-a389-bb179d27da58 service nova] [instance: 859f06da-737e-40c3-9e85-2fd33052a9ea] Received event network-vif-deleted-810ff4e6-46ca-448f-ba1c-047dc5db6d75 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:38:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:38:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:38:53 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1d95a79b-847f-4eba-a096-65c834f94a40 is timed out.
Nov 16 05:38:53 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Successfully detached device vdc from instance 1d95a79b-847f-4eba-a096-65c834f94a40 from the live domain config.
Nov 16 05:38:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SefUPDoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:38:53 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:38:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[098ac365-d058-4d96-84c1-beb1b6fa8d17]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:38:53 user nova-compute[80928]: No targets found.
Nov 16 05:38:53 user nova-compute[80928]: iSNS:
Nov 16 05:38:53 user nova-compute[80928]: No targets found.
Nov 16 05:38:53 user nova-compute[80928]: STATIC:
Nov 16 05:38:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13
Nov 16 05:38:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:38:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:38:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890
Nov 16 05:38:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:38:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:38:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:38:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:38:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:38:53 user nova-compute[80928]: FIRMWARE:
Nov 16 05:38:53 user nova-compute[80928]: No targets found.
Nov 16 05:38:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:38:53 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:38:53 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a47d17-8b89-4810-a52d-2a8e225e7435]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db8442e-761c-4f9f-89b5-5e82122eafa4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:38:53 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:38:53 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:38:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:38:53 user nova-compute[80928]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 (non-flash)
Nov 16 05:38:53 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:38:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8658352dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890'): ({'sde'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Removing single pathed devices sde {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f590a97-515b-41a6-bbb1-fc215d9eeaae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb780143-a393-47d9-be2b-7843d6cf082f]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Flushing IO for device /dev/sde {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aec131-9fc6-41a5-a4b1-4af2ffd989d1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:38:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f161865-784e-4861-bfac-e4cdd57b5c4c]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] SCSI volumes sde have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15c1b0f-1087-48ed-ba7a-ff08c2e1cdd5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[194cc0d8-1275-4e12-8894-23e4d25b26a0]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890, portal: 172.16.0.220,3260]
Nov 16 05:38:54 user nova-compute[80928]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890, portal: 172.16.0.220,3260] successful.
Nov 16 05:38:54 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9379a036-959f-4789-a2e3-723a44580890 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[75391f55-42a8-4fcd-b205-ed1236525baf]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] <== disconnect_volume: return (320ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:38:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:38:56 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'flavor' on Instance uuid 1d95a79b-847f-4eba-a096-65c834f94a40 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:38:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77a0240d-8c6b-43de-9621-8c82c819ba08 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "1d95a79b-847f-4eba-a096-65c834f94a40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.837s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:38:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:38:57 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:38:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:38:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:39:00 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:39:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Updating instance_info_cache with network_info: [{"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Port 42b5d66c-7f70-41b3-b29c-58333c62c7f2 binding to destination host user is already ACTIVE {{(pid=80928) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquired lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:39:01 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating instance_info_cache with network_info: [{"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Releasing lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Creating tmpfile /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/tmp0ywl8blu to verify with other compute node that the instance is on the same shared storage. {{(pid=80928) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-318fc88a-178c-4cef-8e8f-0dfafcae0d29 req-4487dc3d-12dd-4cab-b718-315d05a8c1e0 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-unplugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-318fc88a-178c-4cef-8e8f-0dfafcae0d29 req-4487dc3d-12dd-4cab-b718-315d05a8c1e0 service nova] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-318fc88a-178c-4cef-8e8f-0dfafcae0d29 req-4487dc3d-12dd-4cab-b718-315d05a8c1e0 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-318fc88a-178c-4cef-8e8f-0dfafcae0d29 req-4487dc3d-12dd-4cab-b718-315d05a8c1e0 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-318fc88a-178c-4cef-8e8f-0dfafcae0d29 req-4487dc3d-12dd-4cab-b718-315d05a8c1e0 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] No waiting events found dispatching network-vif-unplugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:39:02 user nova-compute[80928]: WARNING nova.compute.manager [req-318fc88a-178c-4cef-8e8f-0dfafcae0d29 req-4487dc3d-12dd-4cab-b718-315d05a8c1e0 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received unexpected event network-vif-unplugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 for instance with vm_state resized and task_state resize_reverting.
Nov 16 05:39:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Instance destroyed successfully.
Nov 16 05:39:03 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lazy-loading 'resources' on Instance uuid 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:33:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1720886813',display_name='tempest-ServerActionsTestOtherB-server-1720886813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1720886813',id=19,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9liT9/8OcIK+JyCDfTMk3trFPyZpf/7B0mBbUikRHMSTPB1lcjCLvTtHnBj5VmxOBF7smgL7oBOajybgsCgVmXQlH849r5LdVXz3wtlHkH2OG/ZZJDnudNBjLF68+HYQ==',key_name='tempest-keypair-454342651',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:37:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a8884142201406a89f46fdfcfb7cb7e',ramdisk_id='',reservation_id='r-0aqy2onj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1064773206',owner_user_name='tempest-ServerActionsTestOtherB-1064773206-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea9806dcc82048899583dd9f738c109d',uuid=431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converting VIF {"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_vif [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42b5d66c-7f, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4131d9b-4d51-42b3-9bd2-5815f6873b0e) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:39:03 user nova-compute[80928]: INFO os_vif [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f')
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNroILOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:39:03 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4725fe6-b844-43aa-9587-1ae11eddc592]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:39:03 user nova-compute[80928]: No targets found.
Nov 16 05:39:03 user nova-compute[80928]: iSNS:
Nov 16 05:39:03 user nova-compute[80928]: No targets found.
Nov 16 05:39:03 user nova-compute[80928]: STATIC:
Nov 16 05:39:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13
Nov 16 05:39:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:39:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:39:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:39:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:39:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:39:03 user nova-compute[80928]: FIRMWARE:
Nov 16 05:39:03 user nova-compute[80928]: No targets found.
Nov 16 05:39:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:39:03 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:39:03 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bc3ce7-d707-4063-9b55-ab8bae4e9e66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9e0a9e-94a2-407c-ae94-5c01d5cf1870]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:39:03 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:39:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:39:03 user nova-compute[80928]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:39:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86880eaf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13'): ({'sdg'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Removing single pathed devices sdg {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef326e5d-0d3d-493d-81a2-558f10e86931]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df3c3cf-3645-4ca5-b975-0981d764944f]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Flushing IO for device /dev/sdg {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[639ccb4a-d96c-4079-80d9-207c3d08e684]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.060s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f9e0ca-d1e3-4642-a215-d905853b5e5d]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] SCSI volumes sdg have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1947c0-3f83-4fb1-ab44-85b39fb5f4bb]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e7a794-553f-47f3-870e-dcb777373afb]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260]
Nov 16 05:39:03 user nova-compute[80928]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260] successful.
Nov 16 05:39:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd06a6d-5e4d-4ced-b1cb-6a2a672392d7]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] <== disconnect_volume: return (383ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-93e3687b-7535-4480-afdc-52472fc061bc req-e84fac07-e60a-42cb-86a3-3321567a40e8 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-93e3687b-7535-4480-afdc-52472fc061bc req-e84fac07-e60a-42cb-86a3-3321567a40e8 service nova] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-93e3687b-7535-4480-afdc-52472fc061bc req-e84fac07-e60a-42cb-86a3-3321567a40e8 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-93e3687b-7535-4480-afdc-52472fc061bc req-e84fac07-e60a-42cb-86a3-3321567a40e8 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-93e3687b-7535-4480-afdc-52472fc061bc req-e84fac07-e60a-42cb-86a3-3321567a40e8 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] No waiting events found dispatching network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:39:04 user nova-compute[80928]: WARNING nova.compute.manager [req-93e3687b-7535-4480-afdc-52472fc061bc req-e84fac07-e60a-42cb-86a3-3321567a40e8 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received unexpected event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 for instance with vm_state resized and task_state resize_reverting.
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-b1919224-31b1-4fc8-9e24-109333d4b59d req-64b3e752-be19-4e3a-ae76-dbf621acd986 service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Received event network-changed-344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-b1919224-31b1-4fc8-9e24-109333d4b59d req-64b3e752-be19-4e3a-ae76-dbf621acd986 service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Refreshing instance network info cache due to event network-changed-344ee51b-d7e6-4813-97b2-7434273589c3. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b1919224-31b1-4fc8-9e24-109333d4b59d req-64b3e752-be19-4e3a-ae76-dbf621acd986 service nova] Acquiring lock "refresh_cache-3255dd8b-2060-470f-a4bb-08594977342e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b1919224-31b1-4fc8-9e24-109333d4b59d req-64b3e752-be19-4e3a-ae76-dbf621acd986 service nova] Acquired lock "refresh_cache-3255dd8b-2060-470f-a4bb-08594977342e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-b1919224-31b1-4fc8-9e24-109333d4b59d req-64b3e752-be19-4e3a-ae76-dbf621acd986 service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Refreshing network info cache for port 344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:39:06 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:39:06 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7386MB free_disk=25.300479888916016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Applying migration context for instance 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc as it has an incoming, in-progress migration 7d993896-ad98-4861-aac2-d9e3321576f7. Migration status is reverting {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 05:39:06 user nova-compute[80928]: INFO nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating resource usage from migration 7d993896-ad98-4861-aac2-d9e3321576f7
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance c5ae2c42-de68-4619-96a1-643755597b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 1d95a79b-847f-4eba-a096-65c834f94a40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Migration 7d993896-ad98-4861-aac2-d9e3321576f7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 3255dd8b-2060-470f-a4bb-08594977342e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 310c7fc9-af32-42dd-be30-8460daa03279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-b1919224-31b1-4fc8-9e24-109333d4b59d req-64b3e752-be19-4e3a-ae76-dbf621acd986 service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Updated VIF entry in instance network info cache for port 344ee51b-d7e6-4813-97b2-7434273589c3. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-b1919224-31b1-4fc8-9e24-109333d4b59d req-64b3e752-be19-4e3a-ae76-dbf621acd986 service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Updating instance_info_cache with network_info: [{"id": "344ee51b-d7e6-4813-97b2-7434273589c3", "address": "fa:16:3e:81:8c:4a", "network": {"id": "07881f2c-0956-470f-89b1-166df36eee1d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-540690920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "699d28ce9a62462b909d1bb5dc801a0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344ee51b-d7", "ovs_interfaceid": "344ee51b-d7e6-4813-97b2-7434273589c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b1919224-31b1-4fc8-9e24-109333d4b59d req-64b3e752-be19-4e3a-ae76-dbf621acd986 service nova] Releasing lock "refresh_cache-3255dd8b-2060-470f-a4bb-08594977342e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.617s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lazy-loading 'migration_context' on Instance uuid 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.objects.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Object Instance<431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc> lazy-loaded attributes: resources,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:39:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:39:07 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:39:07 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:39:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.422s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:07 user nova-compute[80928]: INFO nova.compute.manager [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Swapping old allocation on dict_keys(['7c2bca45-4d73-4fca-baf6-06c1e78dcd4e']) held by migration 7d993896-ad98-4861-aac2-d9e3321576f7 for instance
Nov 16 05:39:07 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Overwriting current allocation {'allocations': {'7c2bca45-4d73-4fca-baf6-06c1e78dcd4e': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 33}}, 'project_id': '1a8884142201406a89f46fdfcfb7cb7e', 'user_id': 'ea9806dcc82048899583dd9f738c109d', 'consumer_generation': 1} on consumer 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc {{(pid=80928) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 16 05:39:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:39:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquired lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:39:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:39:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating instance_info_cache with network_info: [{"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Releasing lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG os_brick.utils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf02393-7ca2-4ff5-8546-e072f98cb6fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5f95fc-e390-4e4f-826a-eecba5844337]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1b620b-bf79-4b02-b0cd-2103cd88a07a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b187961-09dd-410e-9e0e-acaa7532a3c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:39:08 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:39:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb1c2af-cb95-4390-bd48-04adfe2376fb]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG os_brick.utils [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:39:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "3255dd8b-2060-470f-a4bb-08594977342e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "3255dd8b-2060-470f-a4bb-08594977342e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG nova.objects.instance [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lazy-loading 'flavor' on Instance uuid 3255dd8b-2060-470f-a4bb-08594977342e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "3255dd8b-2060-470f-a4bb-08594977342e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "3255dd8b-2060-470f-a4bb-08594977342e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "3255dd8b-2060-470f-a4bb-08594977342e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:09 user nova-compute[80928]: INFO nova.compute.manager [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Attaching volume 1ddd1be9-2db2-4b5f-b366-c254bf9ebeec to /dev/vdb
Nov 16 05:39:09 user nova-compute[80928]: DEBUG os_brick.utils [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f4e664-f16e-40fc-9817-1cddebb8d751]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9439fefa-f473-4516-a7bd-d35f03ce819a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[70230983-35d0-4ffc-bf9f-f340116c6315]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[00276a44-5753-4d77-be59-1101896b97bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:39:09 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:39:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2672a5f3-9474-4692-b041-93a769990718]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG os_brick.utils [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:39:09 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Updating existing volume attachment record: 73a65788-bf27-4c36-b1a2-06d3d497c570 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:39:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:11 user nova-compute[80928]: INFO nova.compute.manager [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Rescuing
Nov 16 05:39:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:39:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquired lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:39:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:39:12 user nova-compute[80928]: DEBUG nova.network.neutron [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Updating instance_info_cache with network_info: [{"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:39:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Releasing lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:39:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:12 user nova-compute[80928]: DEBUG nova.compute.manager [req-d4225089-7771-42ba-9043-37a0a02e3bda req-c7f27b16-105a-415d-a123-b07b3139c7bf service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received event network-vif-unplugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d4225089-7771-42ba-9043-37a0a02e3bda req-c7f27b16-105a-415d-a123-b07b3139c7bf service nova] Acquiring lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d4225089-7771-42ba-9043-37a0a02e3bda req-c7f27b16-105a-415d-a123-b07b3139c7bf service nova] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d4225089-7771-42ba-9043-37a0a02e3bda req-c7f27b16-105a-415d-a123-b07b3139c7bf service nova] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:12 user nova-compute[80928]: DEBUG nova.compute.manager [req-d4225089-7771-42ba-9043-37a0a02e3bda req-c7f27b16-105a-415d-a123-b07b3139c7bf service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] No waiting events found dispatching network-vif-unplugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:39:12 user nova-compute[80928]: WARNING nova.compute.manager [req-d4225089-7771-42ba-9043-37a0a02e3bda req-c7f27b16-105a-415d-a123-b07b3139c7bf service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received unexpected event network-vif-unplugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 for instance with vm_state active and task_state rescuing.
Nov 16 05:39:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:13 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Instance destroyed successfully.
Nov 16 05:39:13 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Attempting rescue
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=80928) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Instance directory exists: not creating {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 05:39:13 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Creating image(s)
Nov 16 05:39:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "/opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "/opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue" returned: 0 in 0.052s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'migration_context' on Instance uuid 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.objects.base [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Start _get_guest_xml network_info=[{"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "vif_mac": "fa:16:3e:0c:6c:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'resources' on Instance uuid 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.objects.base [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'numa_topology' on Instance uuid 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.objects.base [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:39:13 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:39:13 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.objects.base [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-157193833',display_name='tempest-ServerRescueNegativeTestJSON-server-157193833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-157193833',id=26,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8820092d2a4d50ab092ac90e5e1d3d',ramdisk_id='',reservation_id='r-hcgyag60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-575506684',owner_user_name='tempest-ServerRescueNegativeTestJSON-575506684-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:30Z,user_data=None,user_id='ade947942acc48ef940224970f670985',uuid=2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "vif_mac": "fa:16:3e:0c:6c:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converting VIF {"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "vif_mac": "fa:16:3e:0c:6c:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6c:ee,bridge_name='br-int',has_traffic_filtering=True,id=d4f7139c-fa6d-4a1b-9353-8edcf9a38d18,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f7139c-fa') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.objects.base [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:39:13 user nova-compute[80928]:   <uuid>2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a</uuid>
Nov 16 05:39:13 user nova-compute[80928]:   <name>instance-0000001a</name>
Nov 16 05:39:13 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:39:13 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:39:13 user nova-compute[80928]:   <metadata>
Nov 16 05:39:13 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:39:13 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:39:13 user nova-compute[80928]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-157193833</nova:name>
Nov 16 05:39:13 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:39:13</nova:creationTime>
Nov 16 05:39:13 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:39:13 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:39:13 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:39:13 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:39:13 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:39:13 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:39:13 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:39:13 user nova-compute[80928]:       <nova:owner>
Nov 16 05:39:13 user nova-compute[80928]:         <nova:user uuid="ade947942acc48ef940224970f670985">tempest-ServerRescueNegativeTestJSON-575506684-project-member</nova:user>
Nov 16 05:39:13 user nova-compute[80928]:         <nova:project uuid="bf8820092d2a4d50ab092ac90e5e1d3d">tempest-ServerRescueNegativeTestJSON-575506684</nova:project>
Nov 16 05:39:13 user nova-compute[80928]:       </nova:owner>
Nov 16 05:39:13 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:39:13 user nova-compute[80928]:       <nova:ports>
Nov 16 05:39:13 user nova-compute[80928]:         <nova:port uuid="d4f7139c-fa6d-4a1b-9353-8edcf9a38d18">
Nov 16 05:39:13 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 05:39:13 user nova-compute[80928]:         </nova:port>
Nov 16 05:39:13 user nova-compute[80928]:       </nova:ports>
Nov 16 05:39:13 user nova-compute[80928]:     </nova:instance>
Nov 16 05:39:13 user nova-compute[80928]:   </metadata>
Nov 16 05:39:13 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:39:13 user nova-compute[80928]:     <system>
Nov 16 05:39:13 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:39:13 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:39:13 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:39:13 user nova-compute[80928]:       <entry name="serial">2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a</entry>
Nov 16 05:39:13 user nova-compute[80928]:       <entry name="uuid">2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a</entry>
Nov 16 05:39:13 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:39:13 user nova-compute[80928]:     </system>
Nov 16 05:39:13 user nova-compute[80928]:   </sysinfo>
Nov 16 05:39:13 user nova-compute[80928]:   <os>
Nov 16 05:39:13 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:39:13 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:39:13 user nova-compute[80928]:   </os>
Nov 16 05:39:13 user nova-compute[80928]:   <features>
Nov 16 05:39:13 user nova-compute[80928]:     <acpi/>
Nov 16 05:39:13 user nova-compute[80928]:     <apic/>
Nov 16 05:39:13 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:39:13 user nova-compute[80928]:   </features>
Nov 16 05:39:13 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:39:13 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:39:13 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:39:13 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:39:13 user nova-compute[80928]:   </clock>
Nov 16 05:39:13 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:39:13 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:39:13 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:39:13 user nova-compute[80928]:   </cpu>
Nov 16 05:39:13 user nova-compute[80928]:   <devices>
Nov 16 05:39:13 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:39:13 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:39:13 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue"/>
Nov 16 05:39:13 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:39:13 user nova-compute[80928]:     </disk>
Nov 16 05:39:13 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:39:13 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:39:13 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk"/>
Nov 16 05:39:13 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:39:13 user nova-compute[80928]:     </disk>
Nov 16 05:39:13 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:39:13 user nova-compute[80928]:       <mac address="fa:16:3e:0c:6c:ee"/>
Nov 16 05:39:13 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:39:13 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:39:13 user nova-compute[80928]:       <target dev="tapd4f7139c-fa"/>
Nov 16 05:39:13 user nova-compute[80928]:     </interface>
Nov 16 05:39:13 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:39:13 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/console.log" append="off"/>
Nov 16 05:39:13 user nova-compute[80928]:     </serial>
Nov 16 05:39:13 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:39:13 user nova-compute[80928]:     <video>
Nov 16 05:39:13 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:39:13 user nova-compute[80928]:     </video>
Nov 16 05:39:13 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:39:13 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:39:13 user nova-compute[80928]:     </rng>
Nov 16 05:39:13 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:39:13 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:39:13 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:39:13 user nova-compute[80928]:     </memballoon>
Nov 16 05:39:13 user nova-compute[80928]:   </devices>
Nov 16 05:39:13 user nova-compute[80928]: </domain>
Nov 16 05:39:13 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:39:13 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Instance destroyed successfully.
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:39:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No VIF found with MAC fa:16:3e:0c:6c:ee, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:39:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-5a96250e-7ae4-44c1-9293-89212e9d9d73 req-73326087-1cca-4610-9c86-2f35738f78bc service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received event network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5a96250e-7ae4-44c1-9293-89212e9d9d73 req-73326087-1cca-4610-9c86-2f35738f78bc service nova] Acquiring lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5a96250e-7ae4-44c1-9293-89212e9d9d73 req-73326087-1cca-4610-9c86-2f35738f78bc service nova] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5a96250e-7ae4-44c1-9293-89212e9d9d73 req-73326087-1cca-4610-9c86-2f35738f78bc service nova] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-5a96250e-7ae4-44c1-9293-89212e9d9d73 req-73326087-1cca-4610-9c86-2f35738f78bc service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] No waiting events found dispatching network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:39:14 user nova-compute[80928]: WARNING nova.compute.manager [req-5a96250e-7ae4-44c1-9293-89212e9d9d73 req-73326087-1cca-4610-9c86-2f35738f78bc service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received unexpected event network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 for instance with vm_state active and task_state rescuing.
Nov 16 05:39:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-b6f71fa1-749f-4c28-b5f1-ac1506e24800 req-0a03d0ed-c302-433a-93ef-d2b334681a55 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received event network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6f71fa1-749f-4c28-b5f1-ac1506e24800 req-0a03d0ed-c302-433a-93ef-d2b334681a55 service nova] Acquiring lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6f71fa1-749f-4c28-b5f1-ac1506e24800 req-0a03d0ed-c302-433a-93ef-d2b334681a55 service nova] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6f71fa1-749f-4c28-b5f1-ac1506e24800 req-0a03d0ed-c302-433a-93ef-d2b334681a55 service nova] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-b6f71fa1-749f-4c28-b5f1-ac1506e24800 req-0a03d0ed-c302-433a-93ef-d2b334681a55 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] No waiting events found dispatching network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:39:16 user nova-compute[80928]: WARNING nova.compute.manager [req-b6f71fa1-749f-4c28-b5f1-ac1506e24800 req-0a03d0ed-c302-433a-93ef-d2b334681a55 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received unexpected event network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 for instance with vm_state active and task_state rescuing.
Nov 16 05:39:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-b6f71fa1-749f-4c28-b5f1-ac1506e24800 req-0a03d0ed-c302-433a-93ef-d2b334681a55 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received event network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6f71fa1-749f-4c28-b5f1-ac1506e24800 req-0a03d0ed-c302-433a-93ef-d2b334681a55 service nova] Acquiring lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6f71fa1-749f-4c28-b5f1-ac1506e24800 req-0a03d0ed-c302-433a-93ef-d2b334681a55 service nova] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6f71fa1-749f-4c28-b5f1-ac1506e24800 req-0a03d0ed-c302-433a-93ef-d2b334681a55 service nova] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-b6f71fa1-749f-4c28-b5f1-ac1506e24800 req-0a03d0ed-c302-433a-93ef-d2b334681a55 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] No waiting events found dispatching network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:39:16 user nova-compute[80928]: WARNING nova.compute.manager [req-b6f71fa1-749f-4c28-b5f1-ac1506e24800 req-0a03d0ed-c302-433a-93ef-d2b334681a55 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received unexpected event network-vif-plugged-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 for instance with vm_state active and task_state rescuing.
Nov 16 05:39:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f282c7c4-8f22-442d-b090-1e967264692f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Starting finish_revert_migration {{(pid=80928) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Start _get_guest_xml network_info=[{"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNroILOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc', 'attached_at': '2023-11-16T05:39:18.000000', 'detached_at': '', 'volume_id': '04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'serial': '04b116c5-edf0-4afd-b73c-74bef2ce3b13'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e1a7df69-f7bf-457c-b28f-3a5a38b06833', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:39:18 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:39:18 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lazy-loading 'vcpu_model' on Instance uuid 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNroILOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:39:18 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:39:18 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:39:18 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeHmSXst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:39:18 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7541248-06ea-45b9-aa27-a7b20f714520]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:39:18 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb0244b-443a-4d95-be08-92a280a75c0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13] added
Nov 16 05:39:18 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a857ce-17ee-43a4-93ad-6213caecf2c0]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6709841-d458-4ad7-8788-3b3f950a539f]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNroILOF {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNroILOF" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c49caa-165a-4aeb-8959-9d40922abe20]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vNroILOF'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[793ef857-9e73-416e-a747-3cf31f7677c9]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69da323-9d3d-4673-bb2e-40750057e36c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:39:18 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:39:18 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d10aa0-c2eb-4267-bf3a-0cebbf835d45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260]
Nov 16 05:39:18 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260] successful.
Nov 16 05:39:18 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fabcd9-99c3-494a-a213-8a8afc0f8e01]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9da06f6-1c1b-4948-8e2b-9611c7dd4b19]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:39:18 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:39:18 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:39:18 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:39:18 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b76db6a-9b28-47c6-aa4f-d3ed66282b5e]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:39:18 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNroILOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23139393564656463', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139393564656463', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.302s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:39:19 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:39:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:39:19 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:39:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb405e6-b9b4-4fe5-99d7-35b85ee56af6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:39:19 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:33:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1720886813',display_name='tempest-ServerActionsTestOtherB-server-1720886813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1720886813',id=19,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9liT9/8OcIK+JyCDfTMk3trFPyZpf/7B0mBbUikRHMSTPB1lcjCLvTtHnBj5VmxOBF7smgL7oBOajybgsCgVmXQlH849r5LdVXz3wtlHkH2OG/ZZJDnudNBjLF68+HYQ==',key_name='tempest-keypair-454342651',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:37:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1a8884142201406a89f46fdfcfb7cb7e',ramdisk_id='',reservation_id='r-0aqy2onj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1064773206',owner_user_name='tempest-ServerActionsTestOtherB-1064773206-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:39:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea9806dcc82048899583dd9f738c109d',uuid=431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converting VIF {"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:39:19 user nova-compute[80928]:   <uuid>431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc</uuid>
Nov 16 05:39:19 user nova-compute[80928]:   <name>instance-00000013</name>
Nov 16 05:39:19 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:39:19 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:39:19 user nova-compute[80928]:   <metadata>
Nov 16 05:39:19 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:39:19 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:39:19 user nova-compute[80928]:       <nova:name>tempest-ServerActionsTestOtherB-server-1720886813</nova:name>
Nov 16 05:39:19 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:39:18</nova:creationTime>
Nov 16 05:39:19 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:39:19 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:39:19 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:39:19 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:39:19 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:39:19 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:39:19 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:39:19 user nova-compute[80928]:       <nova:owner>
Nov 16 05:39:19 user nova-compute[80928]:         <nova:user uuid="ea9806dcc82048899583dd9f738c109d">tempest-ServerActionsTestOtherB-1064773206-project-member</nova:user>
Nov 16 05:39:19 user nova-compute[80928]:         <nova:project uuid="1a8884142201406a89f46fdfcfb7cb7e">tempest-ServerActionsTestOtherB-1064773206</nova:project>
Nov 16 05:39:19 user nova-compute[80928]:       </nova:owner>
Nov 16 05:39:19 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:39:19 user nova-compute[80928]:       <nova:ports>
Nov 16 05:39:19 user nova-compute[80928]:         <nova:port uuid="42b5d66c-7f70-41b3-b29c-58333c62c7f2">
Nov 16 05:39:19 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 05:39:19 user nova-compute[80928]:         </nova:port>
Nov 16 05:39:19 user nova-compute[80928]:       </nova:ports>
Nov 16 05:39:19 user nova-compute[80928]:     </nova:instance>
Nov 16 05:39:19 user nova-compute[80928]:   </metadata>
Nov 16 05:39:19 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:39:19 user nova-compute[80928]:     <system>
Nov 16 05:39:19 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:39:19 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:39:19 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:39:19 user nova-compute[80928]:       <entry name="serial">431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc</entry>
Nov 16 05:39:19 user nova-compute[80928]:       <entry name="uuid">431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc</entry>
Nov 16 05:39:19 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:39:19 user nova-compute[80928]:     </system>
Nov 16 05:39:19 user nova-compute[80928]:   </sysinfo>
Nov 16 05:39:19 user nova-compute[80928]:   <os>
Nov 16 05:39:19 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:39:19 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:39:19 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:39:19 user nova-compute[80928]:   </os>
Nov 16 05:39:19 user nova-compute[80928]:   <features>
Nov 16 05:39:19 user nova-compute[80928]:     <acpi/>
Nov 16 05:39:19 user nova-compute[80928]:     <apic/>
Nov 16 05:39:19 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:39:19 user nova-compute[80928]:   </features>
Nov 16 05:39:19 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:39:19 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:39:19 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:39:19 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:39:19 user nova-compute[80928]:   </clock>
Nov 16 05:39:19 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:39:19 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:39:19 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:39:19 user nova-compute[80928]:   </cpu>
Nov 16 05:39:19 user nova-compute[80928]:   <devices>
Nov 16 05:39:19 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:39:19 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:39:19 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk"/>
Nov 16 05:39:19 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:39:19 user nova-compute[80928]:     </disk>
Nov 16 05:39:19 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:39:19 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:39:19 user nova-compute[80928]:       <source dev="/dev/sdc"/>
Nov 16 05:39:19 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:39:19 user nova-compute[80928]:       <serial>04b116c5-edf0-4afd-b73c-74bef2ce3b13</serial>
Nov 16 05:39:19 user nova-compute[80928]:     </disk>
Nov 16 05:39:19 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:39:19 user nova-compute[80928]:       <mac address="fa:16:3e:58:5c:e5"/>
Nov 16 05:39:19 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:39:19 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:39:19 user nova-compute[80928]:       <target dev="tap42b5d66c-7f"/>
Nov 16 05:39:19 user nova-compute[80928]:     </interface>
Nov 16 05:39:19 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:39:19 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/console.log" append="off"/>
Nov 16 05:39:19 user nova-compute[80928]:     </serial>
Nov 16 05:39:19 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:39:19 user nova-compute[80928]:     <video>
Nov 16 05:39:19 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:39:19 user nova-compute[80928]:     </video>
Nov 16 05:39:19 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:39:19 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:39:19 user nova-compute[80928]:     </rng>
Nov 16 05:39:19 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:39:19 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:39:19 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:39:19 user nova-compute[80928]:     </memballoon>
Nov 16 05:39:19 user nova-compute[80928]:   </devices>
Nov 16 05:39:19 user nova-compute[80928]: </domain>
Nov 16 05:39:19 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:33:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1720886813',display_name='tempest-ServerActionsTestOtherB-server-1720886813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1720886813',id=19,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9liT9/8OcIK+JyCDfTMk3trFPyZpf/7B0mBbUikRHMSTPB1lcjCLvTtHnBj5VmxOBF7smgL7oBOajybgsCgVmXQlH849r5LdVXz3wtlHkH2OG/ZZJDnudNBjLF68+HYQ==',key_name='tempest-keypair-454342651',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:37:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1a8884142201406a89f46fdfcfb7cb7e',ramdisk_id='',reservation_id='r-0aqy2onj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1064773206',owner_user_name='tempest-ServerActionsTestOtherB-1064773206-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:39:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea9806dcc82048899583dd9f738c109d',uuid=431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converting VIF {"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG os_vif [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e1511b2-4dd6-5162-9e3f-54d9378556da', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c109bc13-4a5a-4a2a-83bc-1e5b4a3fb1b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec] added
Nov 16 05:39:19 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42b5d66c-7f, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42b5d66c-7f, col_values=(('qos', UUID('15554258-f456-4e40-89e0-0c366d62627e')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42b5d66c-7f, col_values=(('external_ids', {'iface-id': '42b5d66c-7f70-41b3-b29c-58333c62c7f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:5c:e5', 'vm-uuid': '431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:19 user nova-compute[80928]: INFO os_vif [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f')
Nov 16 05:39:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d26e652-ecbe-4411-a750-6ab348cc51a8]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f3c910-c7d3-4fc1-b3d3-14aee309a870]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeHmSXst {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeHmSXst" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f5454a-65f0-48e9-a988-2d2fcbe9b530]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QeHmSXst'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b00b6b5-418f-4e38-ad5e-fb6c9adaa417]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e972a95-7b81-4a8c-9612-7c35fc340c1c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:39:20 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:39:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:39:20 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:39:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac13986-ef22-4d09-b7da-2b029d3cefb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec, portal: 172.16.0.220,3260]
Nov 16 05:39:20 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec, portal: 172.16.0.220,3260] successful.
Nov 16 05:39:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f4bce2-e473-4129-975a-93180cd0df75]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d636a86-8845-49b8-88c3-1b868945d462]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:39:20 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:39:20 user nova-compute[80928]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec (non-flash)
Nov 16 05:39:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:39:20 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:39:20 user nova-compute[80928]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec (non-flash)
Nov 16 05:39:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[40429332-06e1-45ae-804c-178a0300183f]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeHmSXst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:39:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] <== connect_volume: return (2654ms) {'type': 'block', 'scsi_wwn': '23464323666623635', 'path': '/dev/sdd'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464323666623635', 'path': '/dev/sdd'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG nova.objects.instance [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lazy-loading 'flavor' on Instance uuid 3255dd8b-2060-470f-a4bb-08594977342e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:39:21 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:39:21 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:39:21 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:39:21 user nova-compute[80928]:   <serial>1ddd1be9-2db2-4b5f-b366-c254bf9ebeec</serial>
Nov 16 05:39:21 user nova-compute[80928]: </disk>
Nov 16 05:39:21 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG nova.compute.manager [req-0a90c5df-4214-41f7-8c38-afe97d23e178 req-2065e8c5-8498-4d82-860e-0ec6c09344ee service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0a90c5df-4214-41f7-8c38-afe97d23e178 req-2065e8c5-8498-4d82-860e-0ec6c09344ee service nova] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0a90c5df-4214-41f7-8c38-afe97d23e178 req-2065e8c5-8498-4d82-860e-0ec6c09344ee service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0a90c5df-4214-41f7-8c38-afe97d23e178 req-2065e8c5-8498-4d82-860e-0ec6c09344ee service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG nova.compute.manager [req-0a90c5df-4214-41f7-8c38-afe97d23e178 req-2065e8c5-8498-4d82-860e-0ec6c09344ee service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] No waiting events found dispatching network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:39:21 user nova-compute[80928]: WARNING nova.compute.manager [req-0a90c5df-4214-41f7-8c38-afe97d23e178 req-2065e8c5-8498-4d82-860e-0ec6c09344ee service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received unexpected event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 for instance with vm_state resized and task_state resize_reverting.
Nov 16 05:39:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:39:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] No VIF found with MAC fa:16:3e:81:8c:4a, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:39:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a6daa150-8eaf-4226-bb66-da534b036d15 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "3255dd8b-2060-470f-a4bb-08594977342e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.422s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG nova.compute.manager [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:39:23 user nova-compute[80928]: INFO nova.compute.manager [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] instance snapshotting
Nov 16 05:39:23 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Beginning live snapshot process
Nov 16 05:39:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json -f qcow2 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "1d95a79b-847f-4eba-a096-65c834f94a40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:23 user nova-compute[80928]: INFO nova.compute.manager [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Terminating instance
Nov 16 05:39:23 user nova-compute[80928]: DEBUG nova.compute.manager [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json -f qcow2 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-e822d0b6-9424-4cb8-812d-8ee928d20828 req-aff3f6fc-b02c-4198-8e44-d3a3f49ca309 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e822d0b6-9424-4cb8-812d-8ee928d20828 req-aff3f6fc-b02c-4198-8e44-d3a3f49ca309 service nova] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e822d0b6-9424-4cb8-812d-8ee928d20828 req-aff3f6fc-b02c-4198-8e44-d3a3f49ca309 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e822d0b6-9424-4cb8-812d-8ee928d20828 req-aff3f6fc-b02c-4198-8e44-d3a3f49ca309 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-e822d0b6-9424-4cb8-812d-8ee928d20828 req-aff3f6fc-b02c-4198-8e44-d3a3f49ca309 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] No waiting events found dispatching network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:39:23 user nova-compute[80928]: WARNING nova.compute.manager [req-e822d0b6-9424-4cb8-812d-8ee928d20828 req-aff3f6fc-b02c-4198-8e44-d3a3f49ca309 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received unexpected event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 for instance with vm_state resized and task_state resize_reverting.
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-4dd4407d-428e-4b56-a66c-43b2e5be2165 req-4162471c-92f3-4265-ac4d-dbef132c965d service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-vif-unplugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4dd4407d-428e-4b56-a66c-43b2e5be2165 req-4162471c-92f3-4265-ac4d-dbef132c965d service nova] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4dd4407d-428e-4b56-a66c-43b2e5be2165 req-4162471c-92f3-4265-ac4d-dbef132c965d service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4dd4407d-428e-4b56-a66c-43b2e5be2165 req-4162471c-92f3-4265-ac4d-dbef132c965d service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-4dd4407d-428e-4b56-a66c-43b2e5be2165 req-4162471c-92f3-4265-ac4d-dbef132c965d service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] No waiting events found dispatching network-vif-unplugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-4dd4407d-428e-4b56-a66c-43b2e5be2165 req-4162471c-92f3-4265-ac4d-dbef132c965d service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-vif-unplugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json -f qcow2" returned: 0 in 0.624s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:24 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Instance destroyed successfully.
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.objects.instance [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'resources' on Instance uuid 1d95a79b-847f-4eba-a096-65c834f94a40 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-829617757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-829617757',id=18,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBVIcuLIoeyJUCfApF95eDV2Wo0tU7REYxuVWr/fb1xvg+3fDUjymswWM+MIn+/kdz99QUdgvxCYkYWnfYA61PMztbyoXcQ7rWJGut8ydbk3LZT4zuI8EfyKedqfH+Inw==',key_name='tempest-keypair-1667699851',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:37:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9efdd13a65f44182a910ecf45bf27116',ramdisk_id='',reservation_id='r-y0372kuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-658694431',owner_user_name='tempest-AttachVolumeShelveTestJSON-658694431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:37:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='505358920a9e43c59cf29b85ffbccb95',uuid=1d95a79b-847f-4eba-a096-65c834f94a40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converting VIF {"id": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "address": "fa:16:3e:cb:36:8f", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fd63666-00", "ovs_interfaceid": "3fd63666-004c-416e-877a-dbc4fcbe6fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG os_vif [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fd63666-00, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.202s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphl7bmnpa/01167f01f41c476a8d713b8fced593a9.delta 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a004e99-618e-485a-9cde-da2fada72066) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphl7bmnpa/01167f01f41c476a8d713b8fced593a9.delta 1073741824" returned: 0 in 0.057s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:39:24 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 05:39:24 user nova-compute[80928]: INFO os_vif [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:36:8f,bridge_name='br-int',has_traffic_filtering=True,id=3fd63666-004c-416e-877a-dbc4fcbe6fcd,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fd63666-00')
Nov 16 05:39:24 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Deleting instance files /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40_del
Nov 16 05:39:24 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Deletion of /opt/stack/data/nova/instances/1d95a79b-847f-4eba-a096-65c834f94a40_del complete
Nov 16 05:39:24 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Instance running successfully.
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] finish_revert_migration finished successfully. {{(pid=80928) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 16 05:39:24 user nova-compute[80928]: INFO nova.compute.manager [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:39:24 user nova-compute[80928]: INFO nova.compute.claims [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Claim successful on node user
Nov 16 05:39:24 user nova-compute[80928]: INFO nova.compute.manager [None req-f2ada0c7-1153-40f4-a5d6-99ce16b11ba1 tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating instance to original state: 'active'
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "3255dd8b-2060-470f-a4bb-08594977342e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "3255dd8b-2060-470f-a4bb-08594977342e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:24 user nova-compute[80928]: INFO nova.compute.manager [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Detaching volume 1ddd1be9-2db2-4b5f-b366-c254bf9ebeec
Nov 16 05:39:25 user nova-compute[80928]: INFO nova.virt.block_device [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Attempting to driver detach volume 1ddd1be9-2db2-4b5f-b366-c254bf9ebeec from mountpoint /dev/vdb
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Attempting to detach device vdb from instance 3255dd8b-2060-470f-a4bb-08594977342e from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:39:25 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:39:25 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:39:25 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:39:25 user nova-compute[80928]:   <serial>1ddd1be9-2db2-4b5f-b366-c254bf9ebeec</serial>
Nov 16 05:39:25 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:39:25 user nova-compute[80928]: </disk>
Nov 16 05:39:25 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:39:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Successfully detached device vdb from instance 3255dd8b-2060-470f-a4bb-08594977342e from the persistent domain config.
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3255dd8b-2060-470f-a4bb-08594977342e from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:39:25 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:39:25 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:39:25 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:39:25 user nova-compute[80928]:   <serial>1ddd1be9-2db2-4b5f-b366-c254bf9ebeec</serial>
Nov 16 05:39:25 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:39:25 user nova-compute[80928]: </disk>
Nov 16 05:39:25 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:39:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:39:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.network.neutron [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3255dd8b-2060-470f-a4bb-08594977342e {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:39:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:39:25 user nova-compute[80928]: DEBUG nova.policy [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '952a7ea7e63649259b0b1e0df40c97d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f585dcb9e6cb432a9b04526ebc30e9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] COPY block job progress, current cursor: 16318464 final cursor: 75497472 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:39:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Creating image(s)
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "/opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "/opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "/opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-ef3e4fa8-1991-45d6-bcce-5c31afdc1850 req-eead6223-c10a-4a69-abe7-6301dc8f46a3 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ef3e4fa8-1991-45d6-bcce-5c31afdc1850 req-eead6223-c10a-4a69-abe7-6301dc8f46a3 service nova] Acquiring lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ef3e4fa8-1991-45d6-bcce-5c31afdc1850 req-eead6223-c10a-4a69-abe7-6301dc8f46a3 service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ef3e4fa8-1991-45d6-bcce-5c31afdc1850 req-eead6223-c10a-4a69-abe7-6301dc8f46a3 service nova] Lock "1d95a79b-847f-4eba-a096-65c834f94a40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-ef3e4fa8-1991-45d6-bcce-5c31afdc1850 req-eead6223-c10a-4a69-abe7-6301dc8f46a3 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] No waiting events found dispatching network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:39:26 user nova-compute[80928]: WARNING nova.compute.manager [req-ef3e4fa8-1991-45d6-bcce-5c31afdc1850 req-eead6223-c10a-4a69-abe7-6301dc8f46a3 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received unexpected event network-vif-plugged-3fd63666-004c-416e-877a-dbc4fcbe6fcd for instance with vm_state active and task_state deleting.
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.204s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:39:26 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Took 1.68 seconds to deallocate network for instance.
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-4404b32d-7dc8-478b-b0d8-0950853b7c0b req-68050865-f918-4abc-8401-d2723a5ff568 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Received event network-vif-deleted-3fd63666-004c-416e-877a-dbc4fcbe6fcd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:26 user nova-compute[80928]: INFO nova.compute.manager [req-4404b32d-7dc8-478b-b0d8-0950853b7c0b req-68050865-f918-4abc-8401-d2723a5ff568 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Neutron deleted interface 3fd63666-004c-416e-877a-dbc4fcbe6fcd; detaching it from the instance and deleting it from the info cache
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.network.neutron [req-4404b32d-7dc8-478b-b0d8-0950853b7c0b req-68050865-f918-4abc-8401-d2723a5ff568 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-4404b32d-7dc8-478b-b0d8-0950853b7c0b req-68050865-f918-4abc-8401-d2723a5ff568 service nova] [instance: 1d95a79b-847f-4eba-a096-65c834f94a40] Detach interface failed, port_id=3fd63666-004c-416e-877a-dbc4fcbe6fcd, reason: Instance 1d95a79b-847f-4eba-a096-65c834f94a40 could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.218s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:39:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk 1073741824" returned: 0 in 0.072s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphl7bmnpa/01167f01f41c476a8d713b8fced593a9.delta /opt/stack/data/nova/instances/snapshots/tmphl7bmnpa/01167f01f41c476a8d713b8fced593a9 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.204s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.network.neutron [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Successfully created port: 4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Cannot resize image /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Ensure instance console log exists: /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:27 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:39:27 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:39:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.945s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:27 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Deleted allocations for instance 1d95a79b-847f-4eba-a096-65c834f94a40
Nov 16 05:39:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6cdcf4fb-c283-48e6-99c8-7866f9d1a900 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "1d95a79b-847f-4eba-a096-65c834f94a40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.074s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphl7bmnpa/01167f01f41c476a8d713b8fced593a9.delta /opt/stack/data/nova/instances/snapshots/tmphl7bmnpa/01167f01f41c476a8d713b8fced593a9" returned: 0 in 1.025s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:27 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Snapshot extracted, beginning image upload
Nov 16 05:39:27 user nova-compute[80928]: DEBUG nova.network.neutron [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Successfully updated port: 4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "refresh_cache-01efd111-31ef-415e-aeb9-a87bb5d6e33b" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquired lock "refresh_cache-01efd111-31ef-415e-aeb9-a87bb5d6e33b" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-33bafdb8-a430-44fe-8038-e77a3db81af0 req-9d1939c1-2807-4277-8b74-375af07722d0 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received event network-changed-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-33bafdb8-a430-44fe-8038-e77a3db81af0 req-9d1939c1-2807-4277-8b74-375af07722d0 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Refreshing instance network info cache due to event network-changed-4c9af068-8329-4b75-8da2-e59e199a8464. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-33bafdb8-a430-44fe-8038-e77a3db81af0 req-9d1939c1-2807-4277-8b74-375af07722d0 service nova] Acquiring lock "refresh_cache-01efd111-31ef-415e-aeb9-a87bb5d6e33b" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Updating instance_info_cache with network_info: [{"id": "4c9af068-8329-4b75-8da2-e59e199a8464", "address": "fa:16:3e:87:f6:8a", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9af068-83", "ovs_interfaceid": "4c9af068-8329-4b75-8da2-e59e199a8464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Releasing lock "refresh_cache-01efd111-31ef-415e-aeb9-a87bb5d6e33b" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Instance network_info: |[{"id": "4c9af068-8329-4b75-8da2-e59e199a8464", "address": "fa:16:3e:87:f6:8a", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9af068-83", "ovs_interfaceid": "4c9af068-8329-4b75-8da2-e59e199a8464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-33bafdb8-a430-44fe-8038-e77a3db81af0 req-9d1939c1-2807-4277-8b74-375af07722d0 service nova] Acquired lock "refresh_cache-01efd111-31ef-415e-aeb9-a87bb5d6e33b" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.network.neutron [req-33bafdb8-a430-44fe-8038-e77a3db81af0 req-9d1939c1-2807-4277-8b74-375af07722d0 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Refreshing network info cache for port 4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Start _get_guest_xml network_info=[{"id": "4c9af068-8329-4b75-8da2-e59e199a8464", "address": "fa:16:3e:87:f6:8a", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9af068-83", "ovs_interfaceid": "4c9af068-8329-4b75-8da2-e59e199a8464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:39:28 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:39:28 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1126435101',display_name='tempest-AttachVolumeNegativeTest-server-1126435101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1126435101',id=28,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmhiSFQlKh7qSut4valIfzaukdrv7qM4/gIsKjpGWgtLArdjpY+ZM/7ZhG76Z1Mw3rH3j8IZf/jo+69H2tTF/mIj7njddvIEfZKbLVuS3n3YEHgg+W0j0/3i9eYCnwIuw==',key_name='tempest-keypair-26332102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f585dcb9e6cb432a9b04526ebc30e9d8',ramdisk_id='',reservation_id='r-l2f0na8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-155531213',owner_user_name='tempest-AttachVolumeNegativeTest-155531213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952a7ea7e63649259b0b1e0df40c97d0',uuid=01efd111-31ef-415e-aeb9-a87bb5d6e33b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c9af068-8329-4b75-8da2-e59e199a8464", "address": "fa:16:3e:87:f6:8a", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9af068-83", "ovs_interfaceid": "4c9af068-8329-4b75-8da2-e59e199a8464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converting VIF {"id": "4c9af068-8329-4b75-8da2-e59e199a8464", "address": "fa:16:3e:87:f6:8a", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9af068-83", "ovs_interfaceid": "4c9af068-8329-4b75-8da2-e59e199a8464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:8a,bridge_name='br-int',has_traffic_filtering=True,id=4c9af068-8329-4b75-8da2-e59e199a8464,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9af068-83') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.objects.instance [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'pci_devices' on Instance uuid 01efd111-31ef-415e-aeb9-a87bb5d6e33b {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:39:28 user nova-compute[80928]:   <uuid>01efd111-31ef-415e-aeb9-a87bb5d6e33b</uuid>
Nov 16 05:39:28 user nova-compute[80928]:   <name>instance-0000001c</name>
Nov 16 05:39:28 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:39:28 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:39:28 user nova-compute[80928]:   <metadata>
Nov 16 05:39:28 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:39:28 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:39:28 user nova-compute[80928]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1126435101</nova:name>
Nov 16 05:39:28 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:39:28</nova:creationTime>
Nov 16 05:39:28 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:39:28 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:39:28 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:39:28 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:39:28 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:39:28 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:39:28 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:39:28 user nova-compute[80928]:       <nova:owner>
Nov 16 05:39:28 user nova-compute[80928]:         <nova:user uuid="952a7ea7e63649259b0b1e0df40c97d0">tempest-AttachVolumeNegativeTest-155531213-project-member</nova:user>
Nov 16 05:39:28 user nova-compute[80928]:         <nova:project uuid="f585dcb9e6cb432a9b04526ebc30e9d8">tempest-AttachVolumeNegativeTest-155531213</nova:project>
Nov 16 05:39:28 user nova-compute[80928]:       </nova:owner>
Nov 16 05:39:28 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:39:28 user nova-compute[80928]:       <nova:ports>
Nov 16 05:39:28 user nova-compute[80928]:         <nova:port uuid="4c9af068-8329-4b75-8da2-e59e199a8464">
Nov 16 05:39:28 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 05:39:28 user nova-compute[80928]:         </nova:port>
Nov 16 05:39:28 user nova-compute[80928]:       </nova:ports>
Nov 16 05:39:28 user nova-compute[80928]:     </nova:instance>
Nov 16 05:39:28 user nova-compute[80928]:   </metadata>
Nov 16 05:39:28 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:39:28 user nova-compute[80928]:     <system>
Nov 16 05:39:28 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:39:28 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:39:28 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:39:28 user nova-compute[80928]:       <entry name="serial">01efd111-31ef-415e-aeb9-a87bb5d6e33b</entry>
Nov 16 05:39:28 user nova-compute[80928]:       <entry name="uuid">01efd111-31ef-415e-aeb9-a87bb5d6e33b</entry>
Nov 16 05:39:28 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:39:28 user nova-compute[80928]:     </system>
Nov 16 05:39:28 user nova-compute[80928]:   </sysinfo>
Nov 16 05:39:28 user nova-compute[80928]:   <os>
Nov 16 05:39:28 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:39:28 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:39:28 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:39:28 user nova-compute[80928]:   </os>
Nov 16 05:39:28 user nova-compute[80928]:   <features>
Nov 16 05:39:28 user nova-compute[80928]:     <acpi/>
Nov 16 05:39:28 user nova-compute[80928]:     <apic/>
Nov 16 05:39:28 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:39:28 user nova-compute[80928]:   </features>
Nov 16 05:39:28 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:39:28 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:39:28 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:39:28 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:39:28 user nova-compute[80928]:   </clock>
Nov 16 05:39:28 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:39:28 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:39:28 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:39:28 user nova-compute[80928]:   </cpu>
Nov 16 05:39:28 user nova-compute[80928]:   <devices>
Nov 16 05:39:28 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:39:28 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:39:28 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk"/>
Nov 16 05:39:28 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:39:28 user nova-compute[80928]:     </disk>
Nov 16 05:39:28 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:39:28 user nova-compute[80928]:       <mac address="fa:16:3e:87:f6:8a"/>
Nov 16 05:39:28 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:39:28 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:39:28 user nova-compute[80928]:       <target dev="tap4c9af068-83"/>
Nov 16 05:39:28 user nova-compute[80928]:     </interface>
Nov 16 05:39:28 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:39:28 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/console.log" append="off"/>
Nov 16 05:39:28 user nova-compute[80928]:     </serial>
Nov 16 05:39:28 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:39:28 user nova-compute[80928]:     <video>
Nov 16 05:39:28 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:39:28 user nova-compute[80928]:     </video>
Nov 16 05:39:28 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:39:28 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:39:28 user nova-compute[80928]:     </rng>
Nov 16 05:39:28 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:39:28 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:39:28 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:39:28 user nova-compute[80928]:     </memballoon>
Nov 16 05:39:28 user nova-compute[80928]:   </devices>
Nov 16 05:39:28 user nova-compute[80928]: </domain>
Nov 16 05:39:28 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1126435101',display_name='tempest-AttachVolumeNegativeTest-server-1126435101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1126435101',id=28,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmhiSFQlKh7qSut4valIfzaukdrv7qM4/gIsKjpGWgtLArdjpY+ZM/7ZhG76Z1Mw3rH3j8IZf/jo+69H2tTF/mIj7njddvIEfZKbLVuS3n3YEHgg+W0j0/3i9eYCnwIuw==',key_name='tempest-keypair-26332102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f585dcb9e6cb432a9b04526ebc30e9d8',ramdisk_id='',reservation_id='r-l2f0na8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-155531213',owner_user_name='tempest-AttachVolumeNegativeTest-155531213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952a7ea7e63649259b0b1e0df40c97d0',uuid=01efd111-31ef-415e-aeb9-a87bb5d6e33b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c9af068-8329-4b75-8da2-e59e199a8464", "address": "fa:16:3e:87:f6:8a", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9af068-83", "ovs_interfaceid": "4c9af068-8329-4b75-8da2-e59e199a8464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converting VIF {"id": "4c9af068-8329-4b75-8da2-e59e199a8464", "address": "fa:16:3e:87:f6:8a", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9af068-83", "ovs_interfaceid": "4c9af068-8329-4b75-8da2-e59e199a8464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:8a,bridge_name='br-int',has_traffic_filtering=True,id=4c9af068-8329-4b75-8da2-e59e199a8464,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9af068-83') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG os_vif [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:8a,bridge_name='br-int',has_traffic_filtering=True,id=4c9af068-8329-4b75-8da2-e59e199a8464,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9af068-83') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4faeddfc-0c3a-567d-8bf1-d0d041a66c38', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c9af068-83, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c9af068-83, col_values=(('qos', UUID('cfb1830d-ce6b-4c73-98a3-c7f841cea64a')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c9af068-83, col_values=(('external_ids', {'iface-id': '4c9af068-8329-4b75-8da2-e59e199a8464', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:f6:8a', 'vm-uuid': '01efd111-31ef-415e-aeb9-a87bb5d6e33b'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:28 user nova-compute[80928]: INFO os_vif [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:8a,bridge_name='br-int',has_traffic_filtering=True,id=4c9af068-8329-4b75-8da2-e59e199a8464,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9af068-83')
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:39:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No VIF found with MAC fa:16:3e:87:f6:8a, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:39:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-33bafdb8-a430-44fe-8038-e77a3db81af0 req-9d1939c1-2807-4277-8b74-375af07722d0 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Updated VIF entry in instance network info cache for port 4c9af068-8329-4b75-8da2-e59e199a8464. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:39:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-33bafdb8-a430-44fe-8038-e77a3db81af0 req-9d1939c1-2807-4277-8b74-375af07722d0 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Updating instance_info_cache with network_info: [{"id": "4c9af068-8329-4b75-8da2-e59e199a8464", "address": "fa:16:3e:87:f6:8a", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9af068-83", "ovs_interfaceid": "4c9af068-8329-4b75-8da2-e59e199a8464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:39:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-33bafdb8-a430-44fe-8038-e77a3db81af0 req-9d1939c1-2807-4277-8b74-375af07722d0 service nova] Releasing lock "refresh_cache-01efd111-31ef-415e-aeb9-a87bb5d6e33b" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:39:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-8cddc8ae-6a5f-404c-bbd7-662d9ce88b6c req-a377d154-e5e6-4842-b046-3794021040b6 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received event network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8cddc8ae-6a5f-404c-bbd7-662d9ce88b6c req-a377d154-e5e6-4842-b046-3794021040b6 service nova] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8cddc8ae-6a5f-404c-bbd7-662d9ce88b6c req-a377d154-e5e6-4842-b046-3794021040b6 service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8cddc8ae-6a5f-404c-bbd7-662d9ce88b6c req-a377d154-e5e6-4842-b046-3794021040b6 service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-8cddc8ae-6a5f-404c-bbd7-662d9ce88b6c req-a377d154-e5e6-4842-b046-3794021040b6 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] No waiting events found dispatching network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:39:30 user nova-compute[80928]: WARNING nova.compute.manager [req-8cddc8ae-6a5f-404c-bbd7-662d9ce88b6c req-a377d154-e5e6-4842-b046-3794021040b6 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received unexpected event network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 for instance with vm_state building and task_state spawning.
Nov 16 05:39:30 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Snapshot image upload complete
Nov 16 05:39:30 user nova-compute[80928]: INFO nova.compute.manager [None req-59dd77da-d6e5-4205-8fea-ca7818af6e53 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Took 7.38 seconds to snapshot the instance on the hypervisor.
Nov 16 05:39:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-3860f07e-b055-4051-86f1-ac86ecf7ed3a req-6dd32b6d-7322-4967-8025-77d4b2a5f7b5 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received event network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:39:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3860f07e-b055-4051-86f1-ac86ecf7ed3a req-6dd32b6d-7322-4967-8025-77d4b2a5f7b5 service nova] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3860f07e-b055-4051-86f1-ac86ecf7ed3a req-6dd32b6d-7322-4967-8025-77d4b2a5f7b5 service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3860f07e-b055-4051-86f1-ac86ecf7ed3a req-6dd32b6d-7322-4967-8025-77d4b2a5f7b5 service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:32 user nova-compute[80928]: DEBUG nova.compute.manager [req-3860f07e-b055-4051-86f1-ac86ecf7ed3a req-6dd32b6d-7322-4967-8025-77d4b2a5f7b5 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] No waiting events found dispatching network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:39:32 user nova-compute[80928]: WARNING nova.compute.manager [req-3860f07e-b055-4051-86f1-ac86ecf7ed3a req-6dd32b6d-7322-4967-8025-77d4b2a5f7b5 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received unexpected event network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 for instance with vm_state building and task_state spawning.
Nov 16 05:39:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:39:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:39:32 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Instance spawned successfully.
Nov 16 05:39:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:39:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:39:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:39:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:39:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:39:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:39:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:39:32 user nova-compute[80928]: INFO nova.compute.manager [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Took 6.86 seconds to spawn the instance on the hypervisor.
Nov 16 05:39:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:39:33 user nova-compute[80928]: INFO nova.compute.manager [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Took 8.27 seconds to build instance.
Nov 16 05:39:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa5f2463-e54d-4b44-afbd-49656b22b5c8 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.534s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:45 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3255dd8b-2060-470f-a4bb-08594977342e is timed out.
Nov 16 05:39:45 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Successfully detached device vdb from instance 3255dd8b-2060-470f-a4bb-08594977342e from the live domain config.
Nov 16 05:39:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeHmSXst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:39:45 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[426f10be-7478-461f-9fe4-a6c1e999cc2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:39:45 user nova-compute[80928]: No targets found.
Nov 16 05:39:45 user nova-compute[80928]: iSNS:
Nov 16 05:39:45 user nova-compute[80928]: No targets found.
Nov 16 05:39:45 user nova-compute[80928]: STATIC:
Nov 16 05:39:45 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13
Nov 16 05:39:45 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:39:45 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:39:45 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec
Nov 16 05:39:45 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:39:45 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:39:45 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:39:45 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:39:45 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:39:45 user nova-compute[80928]: FIRMWARE:
Nov 16 05:39:45 user nova-compute[80928]: No targets found.
Nov 16 05:39:45 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:39:45 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:39:45 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09f9fd7-8a0f-43a6-9ecb-7a1924461ba4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c38ec3-839e-4a78-a566-58c375bc88e3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:39:45 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:39:45 user nova-compute[80928]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec (non-flash)
Nov 16 05:39:45 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:39:45 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:39:45 user nova-compute[80928]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec (non-flash)
Nov 16 05:39:45 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8658363490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec'): ({'sdd'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Removing single pathed devices sdd {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c3b6bc-cc2f-4090-929f-5f4ab4af1f0c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc8363-8c83-41e2-8e81-ff28bb741003]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Flushing IO for device /dev/sdd {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0469ee12-0959-489b-9e81-e292267e84ad]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[006ce600-b033-481d-a4ea-e15606cbc32c]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:39:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d65e60f-4515-4baa-bc6e-c9c85fe2ec21]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1c5e6b-5c49-4fd4-b5c8-4286204f54e7]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec, portal: 172.16.0.220,3260]
Nov 16 05:39:46 user nova-compute[80928]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec, portal: 172.16.0.220,3260] successful.
Nov 16 05:39:46 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddd1be9-2db2-4b5f-b366-c254bf9ebeec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9cb9a8-ace3-4caa-8855-d0b8fbcb3417]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] <== disconnect_volume: return (297ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:39:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:39:47 user nova-compute[80928]: DEBUG nova.objects.instance [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lazy-loading 'flavor' on Instance uuid 3255dd8b-2060-470f-a4bb-08594977342e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bb8df90e-d5ed-4880-afbe-9021e494f81a tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "3255dd8b-2060-470f-a4bb-08594977342e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.439s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:53 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:39:53 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances with incomplete migration  {{(pid=80928) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 05:39:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:39:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:39:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "c5ae2c42-de68-4619-96a1-643755597b99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG nova.objects.instance [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lazy-loading 'flavor' on Instance uuid c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "c5ae2c42-de68-4619-96a1-643755597b99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "c5ae2c42-de68-4619-96a1-643755597b99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:39:59 user nova-compute[80928]: INFO nova.compute.manager [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Attaching volume ecbd670a-5d3b-4a78-9552-3fb8281a572b to /dev/vdb
Nov 16 05:39:59 user nova-compute[80928]: DEBUG os_brick.utils [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fa7c1f-fb19-4011-acb4-ca82c5a81a01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47e5bd3-2a69-46f6-900a-0b643f6dc959]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc4c67f-66b4-4649-a391-0ff3791e15cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7ba780-4fdf-48fa-9b04-4857cc09a02f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:39:59 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:39:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1fa4f8-2a17-47a9-94fc-eba1d6cfc59e]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG os_brick.utils [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:39:59 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updating existing volume attachment record: e5d279f4-a4c0-4e3b-a453-48348e6eec5e {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:40:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:00 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:40:00 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:40:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:00 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:40:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:40:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:40:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJqPXwEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:40:04 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:40:04 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:40:04 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e45db76-fa40-44fd-ab9e-5b90d153c74b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:40:04 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e87d85-a9db-4b23-8ffa-957189a85b59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b] added
Nov 16 05:40:04 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb7148d-65c8-429e-89a0-edf0fa368ded]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdc40d5-283b-4008-9cd0-7d5c16ac836b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dJqPXwEc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dJqPXwEc" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b18ec7b-abb1-4780-a2a8-ddf68f7ebbfd]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dJqPXwEc'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdae3d72-bde7-4570-926d-a74b22b4ba01]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2097b932-140c-4766-b45f-533e32a857eb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:04 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:04 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:04 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:04 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e5c58c-215f-44bd-902d-fa2649e62096]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b, portal: 172.16.0.220,3260]
Nov 16 05:40:04 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b, portal: 172.16.0.220,3260] successful.
Nov 16 05:40:04 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[61857d6a-64a2-4583-ade1-bd1ffe70eda0]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7629b874-3d07-4558-a436-b88666fa125f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:04 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:04 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:40:04 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:04 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:04 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:40:04 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06e8de4-f8cf-47af-bbcf-b3139142ab96]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:40:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJqPXwEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:40:05 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:40:05 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7569MB free_disk=25.265331268310547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance c5ae2c42-de68-4619-96a1-643755597b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 3255dd8b-2060-470f-a4bb-08594977342e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 310c7fc9-af32-42dd-be30-8460daa03279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 01efd111-31ef-415e-aeb9-a87bb5d6e33b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing inventories for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating ProviderTree inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing aggregate associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, aggregates: None {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing trait associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23065333733646338', 'path': '/dev/sdd'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065333733646338', 'path': '/dev/sdd'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.objects.instance [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lazy-loading 'flavor' on Instance uuid c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:40:05 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:40:05 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:40:05 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:40:05 user nova-compute[80928]:   <serial>ecbd670a-5d3b-4a78-9552-3fb8281a572b</serial>
Nov 16 05:40:05 user nova-compute[80928]: </disk>
Nov 16 05:40:05 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:40:05 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:40:06 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:40:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.844s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:40:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:40:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] No VIF found with MAC fa:16:3e:5e:42:ac, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:40:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-afde3423-5ec2-4523-8910-6440519d80af tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "c5ae2c42-de68-4619-96a1-643755597b99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.021s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:40:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:40:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:40:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:40:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:40:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:40:07 user nova-compute[80928]: INFO nova.compute.manager [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Rescuing
Nov 16 05:40:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquired lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating instance_info_cache with network_info: [{"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updating instance_info_cache with network_info: [{"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Releasing lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-1e780f06-e1f2-4dbe-83ba-6e805f4836ff req-771c5179-53db-4fd0-a8c3-fe60125b51d8 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-unplugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1e780f06-e1f2-4dbe-83ba-6e805f4836ff req-771c5179-53db-4fd0-a8c3-fe60125b51d8 service nova] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1e780f06-e1f2-4dbe-83ba-6e805f4836ff req-771c5179-53db-4fd0-a8c3-fe60125b51d8 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1e780f06-e1f2-4dbe-83ba-6e805f4836ff req-771c5179-53db-4fd0-a8c3-fe60125b51d8 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-1e780f06-e1f2-4dbe-83ba-6e805f4836ff req-771c5179-53db-4fd0-a8c3-fe60125b51d8 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] No waiting events found dispatching network-vif-unplugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:40:08 user nova-compute[80928]: WARNING nova.compute.manager [req-1e780f06-e1f2-4dbe-83ba-6e805f4836ff req-771c5179-53db-4fd0-a8c3-fe60125b51d8 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received unexpected event network-vif-unplugged-c5104be0-b766-4a44-807e-b82c40dadbd7 for instance with vm_state active and task_state rescuing.
Nov 16 05:40:08 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Instance destroyed successfully.
Nov 16 05:40:08 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Attempting a stable device rescue
Nov 16 05:40:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=80928) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 05:40:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Instance directory exists: not creating {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 05:40:08 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Creating image(s)
Nov 16 05:40:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "/opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "/opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:08 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lazy-loading 'trusted_certs' on Instance uuid c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:40:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "84443267ad32e1c82281ff43616bffc9ffc257e8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "84443267ad32e1c82281ff43616bffc9ffc257e8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8.part --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8.part --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:09 user nova-compute[80928]: DEBUG nova.virt.images [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] 9e766a4f-1d53-4b45-8969-7303cc263c88 was qcow2, converting to raw {{(pid=80928) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 05:40:09 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:40:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8.part /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8.converted {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG nova.compute.manager [req-d0b301f5-ad23-4fe2-854a-0092d48b5a85 req-088c37e4-f9b9-419b-bfd3-8f9130a78313 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d0b301f5-ad23-4fe2-854a-0092d48b5a85 req-088c37e4-f9b9-419b-bfd3-8f9130a78313 service nova] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d0b301f5-ad23-4fe2-854a-0092d48b5a85 req-088c37e4-f9b9-419b-bfd3-8f9130a78313 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d0b301f5-ad23-4fe2-854a-0092d48b5a85 req-088c37e4-f9b9-419b-bfd3-8f9130a78313 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG nova.compute.manager [req-d0b301f5-ad23-4fe2-854a-0092d48b5a85 req-088c37e4-f9b9-419b-bfd3-8f9130a78313 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] No waiting events found dispatching network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:40:10 user nova-compute[80928]: WARNING nova.compute.manager [req-d0b301f5-ad23-4fe2-854a-0092d48b5a85 req-088c37e4-f9b9-419b-bfd3-8f9130a78313 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received unexpected event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 for instance with vm_state active and task_state rescuing.
Nov 16 05:40:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8.part /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8.converted" returned: 0 in 0.658s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8.converted --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "84443267ad32e1c82281ff43616bffc9ffc257e8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.105s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "84443267ad32e1c82281ff43616bffc9ffc257e8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "84443267ad32e1c82281ff43616bffc9ffc257e8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8 --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8,backing_fmt=raw /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.rescue {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8,backing_fmt=raw /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.rescue" returned: 0 in 0.065s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "84443267ad32e1c82281ff43616bffc9ffc257e8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lazy-loading 'migration_context' on Instance uuid c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.objects.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Object Instance<c5ae2c42-de68-4619-96a1-643755597b99> lazy-loaded attributes: trusted_certs,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Start _get_guest_xml network_info=[{"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "vif_mac": "fa:16:3e:5e:42:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9e766a4f-1d53-4b45-8969-7303cc263c88', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJqPXwEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'c5ae2c42-de68-4619-96a1-643755597b99', 'attached_at': '', 'detached_at': '', 'volume_id': 'ecbd670a-5d3b-4a78-9552-3fb8281a572b', 'serial': 'ecbd670a-5d3b-4a78-9552-3fb8281a572b'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e5d279f4-a4c0-4e3b-a453-48348e6eec5e', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lazy-loading 'resources' on Instance uuid c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.objects.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Object Instance<c5ae2c42-de68-4619-96a1-643755597b99> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lazy-loading 'numa_topology' on Instance uuid c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.objects.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Object Instance<c5ae2c42-de68-4619-96a1-643755597b99> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:40:11 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:40:11 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lazy-loading 'vcpu_model' on Instance uuid c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.objects.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Object Instance<c5ae2c42-de68-4619-96a1-643755597b99> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJqPXwEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:40:11 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:40:11 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:40:11 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[62776666-dc31-4b00-9f76-44f7a181f105]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dJqPXwEc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 05:40:11 user nova-compute[80928]: node.name = iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b
Nov 16 05:40:11 user nova-compute[80928]: node.tpgt = -1
Nov 16 05:40:11 user nova-compute[80928]: node.startup = automatic
Nov 16 05:40:11 user nova-compute[80928]: node.leading_login = No
Nov 16 05:40:11 user nova-compute[80928]: iface.iscsi_ifacename = default
Nov 16 05:40:11 user nova-compute[80928]: iface.net_ifacename = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.ipaddress = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.prefix_len = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.hwaddress = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.transport_name = tcp
Nov 16 05:40:11 user nova-compute[80928]: iface.initiatorname = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.state = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.vlan_id = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.vlan_priority = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.vlan_state = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.iface_num = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.mtu = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.port = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.bootproto = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.subnet_mask = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.gateway = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.dhcp_alt_client_id = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.dhcp_dns = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.dhcp_learn_iqn = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.dhcp_vendor_id_state = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.dhcp_vendor_id = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.dhcp_slp_da = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.fragmentation = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.gratuitous_arp = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.incoming_forwarding = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.tos_state = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.tos = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.ttl = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.delayed_ack = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.tcp_nagle = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.tcp_wsf_state = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.tcp_wsf = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.tcp_timer_scale = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.tcp_timestamp = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.redirect = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.def_task_mgmt_timeout = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.header_digest = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.data_digest = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.immediate_data = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.initial_r2t = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.data_seq_inorder = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.data_pdu_inorder = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.erl = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.max_receive_data_len = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.first_burst_len = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.max_outstanding_r2t = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.max_burst_len = 0
Nov 16 05:40:11 user nova-compute[80928]: iface.chap_auth = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.bidi_chap = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.strict_login_compliance = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.discovery_auth = <empty>
Nov 16 05:40:11 user nova-compute[80928]: iface.discovery_logout = <empty>
Nov 16 05:40:11 user nova-compute[80928]: node.discovery_address = <empty>
Nov 16 05:40:11 user nova-compute[80928]: node.discovery_port = 0
Nov 16 05:40:11 user nova-compute[80928]: node.discovery_type = static
Nov 16 05:40:11 user nova-compute[80928]: node.session.initial_cmdsn = 0
Nov 16 05:40:11 user nova-compute[80928]: node.session.initial_login_retry_max = 8
Nov 16 05:40:11 user nova-compute[80928]: node.session.xmit_thread_priority = -20
Nov 16 05:40:11 user nova-compute[80928]: node.session.cmds_max = 128
Nov 16 05:40:11 user nova-compute[80928]: node.session.queue_depth = 32
Nov 16 05:40:11 user nova-compute[80928]: node.session.nr_sessions = 1
Nov 16 05:40:11 user nova-compute[80928]: node.session.auth.authmethod = CHAP
Nov 16 05:40:11 user nova-compute[80928]: node.session.auth.username = dJqPXwEc
Nov 16 05:40:11 user nova-compute[80928]: node.session.auth.password = ***
Nov 16 05:40:11 user nova-compute[80928]: node.session.auth.username_in = <empty>
Nov 16 05:40:11 user nova-compute[80928]: node.session.auth.password_in = <empty>
Nov 16 05:40:11 user nova-compute[80928]: node.session.auth.chap_algs = MD5
Nov 16 05:40:11 user nova-compute[80928]: node.session.timeo.replacement_timeout = 120
Nov 16 05:40:11 user nova-compute[80928]: node.session.err_timeo.abort_timeout = 15
Nov 16 05:40:11 user nova-compute[80928]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 05:40:11 user nova-compute[80928]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 05:40:11 user nova-compute[80928]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 05:40:11 user nova-compute[80928]: node.session.iscsi.FastAbort = Yes
Nov 16 05:40:11 user nova-compute[80928]: node.session.iscsi.InitialR2T = No
Nov 16 05:40:11 user nova-compute[80928]: node.session.iscsi.ImmediateData = Yes
Nov 16 05:40:11 user nova-compute[80928]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 05:40:11 user nova-compute[80928]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 05:40:11 user nova-compute[80928]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 05:40:11 user nova-compute[80928]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 05:40:11 user nova-compute[80928]: node.session.iscsi.MaxConnections = 1
Nov 16 05:40:11 user nova-compute[80928]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 05:40:11 user nova-compute[80928]: node.session.iscsi.ERL = 0
Nov 16 05:40:11 user nova-compute[80928]: node.session.scan = manual
Nov 16 05:40:11 user nova-compute[80928]: node.session.reopen_max = 0
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].address = 172.16.0.220
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].port = 3260
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].startup = manual
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].tcp.window_size = 524288
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].tcp.type_of_service = 0
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].timeo.logout_timeout = 15
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].timeo.login_timeout = 15
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].timeo.auth_timeout = 45
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].iscsi.DataDigest = None
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].iscsi.IFMarker = No
Nov 16 05:40:11 user nova-compute[80928]: node.conn[0].iscsi.OFMarker = No
Nov 16 05:40:11 user nova-compute[80928]: # END RECORD
Nov 16 05:40:11 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47f743b-ec79-4357-bc0e-bb4ee0c23aa6]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77563e2-2432-495b-9ffe-9e0c51cfdd35]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dJqPXwEc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dJqPXwEc" returned: 0 in 0.041s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4048318d-28df-43af-bf43-d64af72e9021]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dJqPXwEc'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2212b2-bac4-41e8-9939-939ceb8269d6]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[846cd48a-676b-4cba-a5ff-7824fd6cb5e9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:11 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:11 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:40:11 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:11 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:11 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:40:11 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.167s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] HCTL ('35', '0', '0', 0) found on session 32 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[67846d21-8fd4-4dfd-8645-f5a24006ef98]: (4, ('0 0 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Searching for a device in session 32 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJqPXwEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.200s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] <== connect_volume: return (201ms) {'type': 'block', 'scsi_wwn': '23065333733646338', 'path': '/dev/sdd'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065333733646338', 'path': '/dev/sdd'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:36:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1482561676',display_name='tempest-ServerStableDeviceRescueTest-server-1482561676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1482561676',id=23,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKM6OfVy/fMoIkNAdBQlGs4YsuhKbjo7U4Pyhuu7nQuz9iHjfG0KiqaWAje4kVGSOOuefUjVyscdxC0DNYuZ5nMnKV1B3Xmel+CsWGIxTUzunTopS8qV71E3xKU2h9HMA==',key_name='tempest-keypair-476297108',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:36:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6f752bfba814502898ca7f73eff7e0d',ramdisk_id='',reservation_id='r-8q6twa87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-805900344',owner_user_name='tempest-ServerStableDeviceRescueTest-805900344-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f937540a5dd54473ad0858f2776ddf66',uuid=c5ae2c42-de68-4619-96a1-643755597b99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "vif_mac": "fa:16:3e:5e:42:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Converting VIF {"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "vif_mac": "fa:16:3e:5e:42:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5104be0-b766-4a44-807e-b82c40dadbd7,network=Network(04fdc294-b4a4-4900-9dae-f650571e0829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5104be0-b7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lazy-loading 'pci_devices' on Instance uuid c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.objects.base [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Object Instance<c5ae2c42-de68-4619-96a1-643755597b99> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:40:11 user nova-compute[80928]:   <uuid>c5ae2c42-de68-4619-96a1-643755597b99</uuid>
Nov 16 05:40:11 user nova-compute[80928]:   <name>instance-00000017</name>
Nov 16 05:40:11 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:40:11 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:40:11 user nova-compute[80928]:   <metadata>
Nov 16 05:40:11 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:40:11 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:40:11 user nova-compute[80928]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1482561676</nova:name>
Nov 16 05:40:11 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:40:11</nova:creationTime>
Nov 16 05:40:11 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:40:11 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:40:11 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:40:11 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:40:11 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:40:11 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:40:11 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:40:11 user nova-compute[80928]:       <nova:owner>
Nov 16 05:40:11 user nova-compute[80928]:         <nova:user uuid="f937540a5dd54473ad0858f2776ddf66">tempest-ServerStableDeviceRescueTest-805900344-project-member</nova:user>
Nov 16 05:40:11 user nova-compute[80928]:         <nova:project uuid="d6f752bfba814502898ca7f73eff7e0d">tempest-ServerStableDeviceRescueTest-805900344</nova:project>
Nov 16 05:40:11 user nova-compute[80928]:       </nova:owner>
Nov 16 05:40:11 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:40:11 user nova-compute[80928]:       <nova:ports>
Nov 16 05:40:11 user nova-compute[80928]:         <nova:port uuid="c5104be0-b766-4a44-807e-b82c40dadbd7">
Nov 16 05:40:11 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 05:40:11 user nova-compute[80928]:         </nova:port>
Nov 16 05:40:11 user nova-compute[80928]:       </nova:ports>
Nov 16 05:40:11 user nova-compute[80928]:     </nova:instance>
Nov 16 05:40:11 user nova-compute[80928]:   </metadata>
Nov 16 05:40:11 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:40:11 user nova-compute[80928]:     <system>
Nov 16 05:40:11 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:40:11 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:40:11 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:40:11 user nova-compute[80928]:       <entry name="serial">c5ae2c42-de68-4619-96a1-643755597b99</entry>
Nov 16 05:40:11 user nova-compute[80928]:       <entry name="uuid">c5ae2c42-de68-4619-96a1-643755597b99</entry>
Nov 16 05:40:11 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:40:11 user nova-compute[80928]:     </system>
Nov 16 05:40:11 user nova-compute[80928]:   </sysinfo>
Nov 16 05:40:11 user nova-compute[80928]:   <os>
Nov 16 05:40:11 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:40:11 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:40:11 user nova-compute[80928]:   </os>
Nov 16 05:40:11 user nova-compute[80928]:   <features>
Nov 16 05:40:11 user nova-compute[80928]:     <acpi/>
Nov 16 05:40:11 user nova-compute[80928]:     <apic/>
Nov 16 05:40:11 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:40:11 user nova-compute[80928]:   </features>
Nov 16 05:40:11 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:40:11 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:40:11 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:40:11 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:40:11 user nova-compute[80928]:   </clock>
Nov 16 05:40:11 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:40:11 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:40:11 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:40:11 user nova-compute[80928]:   </cpu>
Nov 16 05:40:11 user nova-compute[80928]:   <devices>
Nov 16 05:40:11 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:40:11 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:40:11 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk"/>
Nov 16 05:40:11 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:40:11 user nova-compute[80928]:     </disk>
Nov 16 05:40:11 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:40:11 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:40:11 user nova-compute[80928]:       <source dev="/dev/sdd"/>
Nov 16 05:40:11 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:40:11 user nova-compute[80928]:       <serial>ecbd670a-5d3b-4a78-9552-3fb8281a572b</serial>
Nov 16 05:40:11 user nova-compute[80928]:     </disk>
Nov 16 05:40:11 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:40:11 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:40:11 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.rescue"/>
Nov 16 05:40:11 user nova-compute[80928]:       <target dev="vdc" bus="virtio"/>
Nov 16 05:40:11 user nova-compute[80928]:       <boot order="1"/>
Nov 16 05:40:11 user nova-compute[80928]:     </disk>
Nov 16 05:40:11 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:40:11 user nova-compute[80928]:       <mac address="fa:16:3e:5e:42:ac"/>
Nov 16 05:40:11 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:40:11 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:40:11 user nova-compute[80928]:       <target dev="tapc5104be0-b7"/>
Nov 16 05:40:11 user nova-compute[80928]:     </interface>
Nov 16 05:40:11 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:40:11 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/console.log" append="off"/>
Nov 16 05:40:11 user nova-compute[80928]:     </serial>
Nov 16 05:40:11 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:40:11 user nova-compute[80928]:     <video>
Nov 16 05:40:11 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:40:11 user nova-compute[80928]:     </video>
Nov 16 05:40:11 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:40:11 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:40:11 user nova-compute[80928]:     </rng>
Nov 16 05:40:11 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:40:11 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:40:11 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:40:11 user nova-compute[80928]:     </memballoon>
Nov 16 05:40:11 user nova-compute[80928]:   </devices>
Nov 16 05:40:11 user nova-compute[80928]: </domain>
Nov 16 05:40:11 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:40:11 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Instance destroyed successfully.
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] No BDM found with device name vdc, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] No VIF found with MAC fa:16:3e:5e:42:ac, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 05:40:11 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] There are 0 instances to clean {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 05:40:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-9dd2caf7-d5ce-407b-ae36-44e263484d3a req-c2a35277-4e22-441f-b9eb-cb26fdbc3ec5 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9dd2caf7-d5ce-407b-ae36-44e263484d3a req-c2a35277-4e22-441f-b9eb-cb26fdbc3ec5 service nova] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9dd2caf7-d5ce-407b-ae36-44e263484d3a req-c2a35277-4e22-441f-b9eb-cb26fdbc3ec5 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9dd2caf7-d5ce-407b-ae36-44e263484d3a req-c2a35277-4e22-441f-b9eb-cb26fdbc3ec5 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-9dd2caf7-d5ce-407b-ae36-44e263484d3a req-c2a35277-4e22-441f-b9eb-cb26fdbc3ec5 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] No waiting events found dispatching network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:40:13 user nova-compute[80928]: WARNING nova.compute.manager [req-9dd2caf7-d5ce-407b-ae36-44e263484d3a req-c2a35277-4e22-441f-b9eb-cb26fdbc3ec5 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received unexpected event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 for instance with vm_state active and task_state rescuing.
Nov 16 05:40:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7bb5a8dc-faa2-4342-9232-79488a334544 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:40:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-a5a20ad9-dc23-490e-ba34-ed76a8af1565 req-0c3efb16-3d6b-4078-be28-8a2f02444066 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a5a20ad9-dc23-490e-ba34-ed76a8af1565 req-0c3efb16-3d6b-4078-be28-8a2f02444066 service nova] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a5a20ad9-dc23-490e-ba34-ed76a8af1565 req-0c3efb16-3d6b-4078-be28-8a2f02444066 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a5a20ad9-dc23-490e-ba34-ed76a8af1565 req-0c3efb16-3d6b-4078-be28-8a2f02444066 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-a5a20ad9-dc23-490e-ba34-ed76a8af1565 req-0c3efb16-3d6b-4078-be28-8a2f02444066 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] No waiting events found dispatching network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:40:15 user nova-compute[80928]: WARNING nova.compute.manager [req-a5a20ad9-dc23-490e-ba34-ed76a8af1565 req-0c3efb16-3d6b-4078-be28-8a2f02444066 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received unexpected event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 for instance with vm_state active and task_state rescuing.
Nov 16 05:40:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "48435326-337f-4a1f-b213-d6726dc8d874" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:40:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:40:17 user nova-compute[80928]: INFO nova.compute.claims [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Claim successful on node user
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.network.neutron [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:40:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.policy [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '505358920a9e43c59cf29b85ffbccb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efdd13a65f44182a910ecf45bf27116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:40:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Creating image(s)
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "/opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "/opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "/opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "3255dd8b-2060-470f-a4bb-08594977342e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "3255dd8b-2060-470f-a4bb-08594977342e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "3255dd8b-2060-470f-a4bb-08594977342e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "3255dd8b-2060-470f-a4bb-08594977342e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "3255dd8b-2060-470f-a4bb-08594977342e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:18 user nova-compute[80928]: INFO nova.compute.manager [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Terminating instance
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.216s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-a1bb0956-0cf5-4f1e-b0b7-b8e1d1ce2f1e req-61b3dd82-fe2a-4e05-aa5b-888f5264ff2a service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Received event network-vif-unplugged-344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a1bb0956-0cf5-4f1e-b0b7-b8e1d1ce2f1e req-61b3dd82-fe2a-4e05-aa5b-888f5264ff2a service nova] Acquiring lock "3255dd8b-2060-470f-a4bb-08594977342e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a1bb0956-0cf5-4f1e-b0b7-b8e1d1ce2f1e req-61b3dd82-fe2a-4e05-aa5b-888f5264ff2a service nova] Lock "3255dd8b-2060-470f-a4bb-08594977342e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a1bb0956-0cf5-4f1e-b0b7-b8e1d1ce2f1e req-61b3dd82-fe2a-4e05-aa5b-888f5264ff2a service nova] Lock "3255dd8b-2060-470f-a4bb-08594977342e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-a1bb0956-0cf5-4f1e-b0b7-b8e1d1ce2f1e req-61b3dd82-fe2a-4e05-aa5b-888f5264ff2a service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] No waiting events found dispatching network-vif-unplugged-344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-a1bb0956-0cf5-4f1e-b0b7-b8e1d1ce2f1e req-61b3dd82-fe2a-4e05-aa5b-888f5264ff2a service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Received event network-vif-unplugged-344ee51b-d7e6-4813-97b2-7434273589c3 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk 1073741824" returned: 0 in 0.060s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.219s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.network.neutron [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Successfully created port: 23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:19 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Instance destroyed successfully.
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.objects.instance [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lazy-loading 'resources' on Instance uuid 3255dd8b-2060-470f-a4bb-08594977342e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Cannot resize image /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Ensure instance console log exists: /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-578981665',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-578981665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5789816',id=24,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOpNxyZjC0M+TQHg+dvDC96vNDu0Jkf3PCKWAR8HSJ0LMcmPrjGcQrnW8lHJ9iJ958vYeYvWp8dZScTOUUxJpUcdTP/CPLSQ2PFk9DUkkt3o7J5eF00d0503JguQppNeA==',key_name='tempest-keypair-1961297760',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:37:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='699d28ce9a62462b909d1bb5dc801a0f',ramdisk_id='',reservation_id='r-3rfohzf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-879383734',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b59ee86b35a24e9680ce12033601b282',uuid=3255dd8b-2060-470f-a4bb-08594977342e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "344ee51b-d7e6-4813-97b2-7434273589c3", "address": "fa:16:3e:81:8c:4a", "network": {"id": "07881f2c-0956-470f-89b1-166df36eee1d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-540690920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "699d28ce9a62462b909d1bb5dc801a0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344ee51b-d7", "ovs_interfaceid": "344ee51b-d7e6-4813-97b2-7434273589c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Converting VIF {"id": "344ee51b-d7e6-4813-97b2-7434273589c3", "address": "fa:16:3e:81:8c:4a", "network": {"id": "07881f2c-0956-470f-89b1-166df36eee1d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-540690920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "699d28ce9a62462b909d1bb5dc801a0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap344ee51b-d7", "ovs_interfaceid": "344ee51b-d7e6-4813-97b2-7434273589c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:8c:4a,bridge_name='br-int',has_traffic_filtering=True,id=344ee51b-d7e6-4813-97b2-7434273589c3,network=Network(07881f2c-0956-470f-89b1-166df36eee1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344ee51b-d7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG os_vif [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:8c:4a,bridge_name='br-int',has_traffic_filtering=True,id=344ee51b-d7e6-4813-97b2-7434273589c3,network=Network(07881f2c-0956-470f-89b1-166df36eee1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344ee51b-d7') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap344ee51b-d7, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57fdd44f-7759-455d-a9ef-466dce5ded70) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:40:19 user nova-compute[80928]: INFO os_vif [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:8c:4a,bridge_name='br-int',has_traffic_filtering=True,id=344ee51b-d7e6-4813-97b2-7434273589c3,network=Network(07881f2c-0956-470f-89b1-166df36eee1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap344ee51b-d7')
Nov 16 05:40:19 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Deleting instance files /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e_del
Nov 16 05:40:19 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Deletion of /opt/stack/data/nova/instances/3255dd8b-2060-470f-a4bb-08594977342e_del complete
Nov 16 05:40:19 user nova-compute[80928]: INFO nova.compute.manager [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 16 05:40:19 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.network.neutron [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Successfully updated port: 23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquired lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:40:19 user nova-compute[80928]: DEBUG nova.network.neutron [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-c308ef69-45a7-44d5-ae9e-7e365f3b8d8c req-aa1b12ee-4035-4463-bdf2-6886b8534dfb service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-changed-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-c308ef69-45a7-44d5-ae9e-7e365f3b8d8c req-aa1b12ee-4035-4463-bdf2-6886b8534dfb service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Refreshing instance network info cache due to event network-changed-23245452-d757-4f54-bd1f-ad857f7c25da. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c308ef69-45a7-44d5-ae9e-7e365f3b8d8c req-aa1b12ee-4035-4463-bdf2-6886b8534dfb service nova] Acquiring lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Updating instance_info_cache with network_info: [{"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Releasing lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.compute.manager [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Instance network_info: |[{"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c308ef69-45a7-44d5-ae9e-7e365f3b8d8c req-aa1b12ee-4035-4463-bdf2-6886b8534dfb service nova] Acquired lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.network.neutron [req-c308ef69-45a7-44d5-ae9e-7e365f3b8d8c req-aa1b12ee-4035-4463-bdf2-6886b8534dfb service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Refreshing network info cache for port 23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Start _get_guest_xml network_info=[{"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:40:20 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:40:20 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1026899600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1026899600',id=29,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTEsmWvmLnfwWRPHYSw37ebtNtMfKhffLuK4BthyMPgtFmpE97cB9GkBpRVp9gKJTB9uQrQ2oEV9S4BczHv6aMH5QssZrVCQr46XuQS7IOBv81XuBHbCLVnXQmb+RQ0Hg==',key_name='tempest-keypair-851703054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9efdd13a65f44182a910ecf45bf27116',ramdisk_id='',reservation_id='r-c0ou62pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-658694431',owner_user_name='tempest-AttachVolumeShelveTestJSON-658694431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:40:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='505358920a9e43c59cf29b85ffbccb95',uuid=48435326-337f-4a1f-b213-d6726dc8d874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converting VIF {"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.objects.instance [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'pci_devices' on Instance uuid 48435326-337f-4a1f-b213-d6726dc8d874 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:40:20 user nova-compute[80928]:   <uuid>48435326-337f-4a1f-b213-d6726dc8d874</uuid>
Nov 16 05:40:20 user nova-compute[80928]:   <name>instance-0000001d</name>
Nov 16 05:40:20 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:40:20 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:40:20 user nova-compute[80928]:   <metadata>
Nov 16 05:40:20 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:40:20 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:40:20 user nova-compute[80928]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1026899600</nova:name>
Nov 16 05:40:20 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:40:20</nova:creationTime>
Nov 16 05:40:20 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:40:20 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:40:20 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:40:20 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:40:20 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:40:20 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:40:20 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:40:20 user nova-compute[80928]:       <nova:owner>
Nov 16 05:40:20 user nova-compute[80928]:         <nova:user uuid="505358920a9e43c59cf29b85ffbccb95">tempest-AttachVolumeShelveTestJSON-658694431-project-member</nova:user>
Nov 16 05:40:20 user nova-compute[80928]:         <nova:project uuid="9efdd13a65f44182a910ecf45bf27116">tempest-AttachVolumeShelveTestJSON-658694431</nova:project>
Nov 16 05:40:20 user nova-compute[80928]:       </nova:owner>
Nov 16 05:40:20 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:40:20 user nova-compute[80928]:       <nova:ports>
Nov 16 05:40:20 user nova-compute[80928]:         <nova:port uuid="23245452-d757-4f54-bd1f-ad857f7c25da">
Nov 16 05:40:20 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 05:40:20 user nova-compute[80928]:         </nova:port>
Nov 16 05:40:20 user nova-compute[80928]:       </nova:ports>
Nov 16 05:40:20 user nova-compute[80928]:     </nova:instance>
Nov 16 05:40:20 user nova-compute[80928]:   </metadata>
Nov 16 05:40:20 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:40:20 user nova-compute[80928]:     <system>
Nov 16 05:40:20 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:40:20 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:40:20 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:40:20 user nova-compute[80928]:       <entry name="serial">48435326-337f-4a1f-b213-d6726dc8d874</entry>
Nov 16 05:40:20 user nova-compute[80928]:       <entry name="uuid">48435326-337f-4a1f-b213-d6726dc8d874</entry>
Nov 16 05:40:20 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:40:20 user nova-compute[80928]:     </system>
Nov 16 05:40:20 user nova-compute[80928]:   </sysinfo>
Nov 16 05:40:20 user nova-compute[80928]:   <os>
Nov 16 05:40:20 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:40:20 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:40:20 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:40:20 user nova-compute[80928]:   </os>
Nov 16 05:40:20 user nova-compute[80928]:   <features>
Nov 16 05:40:20 user nova-compute[80928]:     <acpi/>
Nov 16 05:40:20 user nova-compute[80928]:     <apic/>
Nov 16 05:40:20 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:40:20 user nova-compute[80928]:   </features>
Nov 16 05:40:20 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:40:20 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:40:20 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:40:20 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:40:20 user nova-compute[80928]:   </clock>
Nov 16 05:40:20 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:40:20 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:40:20 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:40:20 user nova-compute[80928]:   </cpu>
Nov 16 05:40:20 user nova-compute[80928]:   <devices>
Nov 16 05:40:20 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:40:20 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:40:20 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk"/>
Nov 16 05:40:20 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:40:20 user nova-compute[80928]:     </disk>
Nov 16 05:40:20 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:40:20 user nova-compute[80928]:       <mac address="fa:16:3e:4e:5d:e2"/>
Nov 16 05:40:20 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:40:20 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:40:20 user nova-compute[80928]:       <target dev="tap23245452-d7"/>
Nov 16 05:40:20 user nova-compute[80928]:     </interface>
Nov 16 05:40:20 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:40:20 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/console.log" append="off"/>
Nov 16 05:40:20 user nova-compute[80928]:     </serial>
Nov 16 05:40:20 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:40:20 user nova-compute[80928]:     <video>
Nov 16 05:40:20 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:40:20 user nova-compute[80928]:     </video>
Nov 16 05:40:20 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:40:20 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:40:20 user nova-compute[80928]:     </rng>
Nov 16 05:40:20 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:40:20 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:40:20 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:40:20 user nova-compute[80928]:     </memballoon>
Nov 16 05:40:20 user nova-compute[80928]:   </devices>
Nov 16 05:40:20 user nova-compute[80928]: </domain>
Nov 16 05:40:20 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1026899600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1026899600',id=29,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTEsmWvmLnfwWRPHYSw37ebtNtMfKhffLuK4BthyMPgtFmpE97cB9GkBpRVp9gKJTB9uQrQ2oEV9S4BczHv6aMH5QssZrVCQr46XuQS7IOBv81XuBHbCLVnXQmb+RQ0Hg==',key_name='tempest-keypair-851703054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9efdd13a65f44182a910ecf45bf27116',ramdisk_id='',reservation_id='r-c0ou62pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-658694431',owner_user_name='tempest-AttachVolumeShelveTestJSON-658694431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:40:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='505358920a9e43c59cf29b85ffbccb95',uuid=48435326-337f-4a1f-b213-d6726dc8d874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converting VIF {"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG os_vif [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63c464bc-d071-5021-956a-a43ecb4c3d8a', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23245452-d7, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23245452-d7, col_values=(('qos', UUID('3ed4362b-06c8-4a87-a886-be33ce01d760')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23245452-d7, col_values=(('external_ids', {'iface-id': '23245452-d757-4f54-bd1f-ad857f7c25da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:5d:e2', 'vm-uuid': '48435326-337f-4a1f-b213-d6726dc8d874'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:20 user nova-compute[80928]: INFO os_vif [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7')
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] No VIF found with MAC fa:16:3e:4e:5d:e2, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:40:20 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Took 1.14 seconds to deallocate network for instance.
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-5c7a608c-e9a2-40fe-8382-68b16a237829 req-41d9ed27-42f1-4b3a-aa31-f335b89bd73d service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Received event network-vif-deleted-344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.network.neutron [req-c308ef69-45a7-44d5-ae9e-7e365f3b8d8c req-aa1b12ee-4035-4463-bdf2-6886b8534dfb service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Updated VIF entry in instance network info cache for port 23245452-d757-4f54-bd1f-ad857f7c25da. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG nova.network.neutron [req-c308ef69-45a7-44d5-ae9e-7e365f3b8d8c req-aa1b12ee-4035-4463-bdf2-6886b8534dfb service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Updating instance_info_cache with network_info: [{"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:40:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c308ef69-45a7-44d5-ae9e-7e365f3b8d8c req-aa1b12ee-4035-4463-bdf2-6886b8534dfb service nova] Releasing lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:40:21 user nova-compute[80928]: DEBUG nova.compute.manager [req-311aa21b-a69d-44c9-87ef-6f859de6ba0c req-c3e8b750-34e8-4138-b4eb-6b944e57592a service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Received event network-vif-plugged-344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-311aa21b-a69d-44c9-87ef-6f859de6ba0c req-c3e8b750-34e8-4138-b4eb-6b944e57592a service nova] Acquiring lock "3255dd8b-2060-470f-a4bb-08594977342e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-311aa21b-a69d-44c9-87ef-6f859de6ba0c req-c3e8b750-34e8-4138-b4eb-6b944e57592a service nova] Lock "3255dd8b-2060-470f-a4bb-08594977342e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-311aa21b-a69d-44c9-87ef-6f859de6ba0c req-c3e8b750-34e8-4138-b4eb-6b944e57592a service nova] Lock "3255dd8b-2060-470f-a4bb-08594977342e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:21 user nova-compute[80928]: DEBUG nova.compute.manager [req-311aa21b-a69d-44c9-87ef-6f859de6ba0c req-c3e8b750-34e8-4138-b4eb-6b944e57592a service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] No waiting events found dispatching network-vif-plugged-344ee51b-d7e6-4813-97b2-7434273589c3 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:40:21 user nova-compute[80928]: WARNING nova.compute.manager [req-311aa21b-a69d-44c9-87ef-6f859de6ba0c req-c3e8b750-34e8-4138-b4eb-6b944e57592a service nova] [instance: 3255dd8b-2060-470f-a4bb-08594977342e] Received unexpected event network-vif-plugged-344ee51b-d7e6-4813-97b2-7434273589c3 for instance with vm_state deleted and task_state None.
Nov 16 05:40:21 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:40:21 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:40:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:21 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Deleted allocations for instance 3255dd8b-2060-470f-a4bb-08594977342e
Nov 16 05:40:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e8cd27-8b80-4d0b-a55b-14e7d14aa654 tempest-TestServerVolumeAttachScenarioOldVersion-879383734 tempest-TestServerVolumeAttachScenarioOldVersion-879383734-project-member] Lock "3255dd8b-2060-470f-a4bb-08594977342e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.709s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-d46aa82d-6b68-4a5e-9306-835e4c52f159 req-5ce0d2ac-f2da-4991-9bb8-005be87c01fb service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d46aa82d-6b68-4a5e-9306-835e4c52f159 req-5ce0d2ac-f2da-4991-9bb8-005be87c01fb service nova] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d46aa82d-6b68-4a5e-9306-835e4c52f159 req-5ce0d2ac-f2da-4991-9bb8-005be87c01fb service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d46aa82d-6b68-4a5e-9306-835e4c52f159 req-5ce0d2ac-f2da-4991-9bb8-005be87c01fb service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-d46aa82d-6b68-4a5e-9306-835e4c52f159 req-5ce0d2ac-f2da-4991-9bb8-005be87c01fb service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] No waiting events found dispatching network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:40:23 user nova-compute[80928]: WARNING nova.compute.manager [req-d46aa82d-6b68-4a5e-9306-835e4c52f159 req-5ce0d2ac-f2da-4991-9bb8-005be87c01fb service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received unexpected event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da for instance with vm_state building and task_state spawning.
Nov 16 05:40:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-d46aa82d-6b68-4a5e-9306-835e4c52f159 req-5ce0d2ac-f2da-4991-9bb8-005be87c01fb service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d46aa82d-6b68-4a5e-9306-835e4c52f159 req-5ce0d2ac-f2da-4991-9bb8-005be87c01fb service nova] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d46aa82d-6b68-4a5e-9306-835e4c52f159 req-5ce0d2ac-f2da-4991-9bb8-005be87c01fb service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d46aa82d-6b68-4a5e-9306-835e4c52f159 req-5ce0d2ac-f2da-4991-9bb8-005be87c01fb service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-d46aa82d-6b68-4a5e-9306-835e4c52f159 req-5ce0d2ac-f2da-4991-9bb8-005be87c01fb service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] No waiting events found dispatching network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:40:23 user nova-compute[80928]: WARNING nova.compute.manager [req-d46aa82d-6b68-4a5e-9306-835e4c52f159 req-5ce0d2ac-f2da-4991-9bb8-005be87c01fb service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received unexpected event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da for instance with vm_state building and task_state spawning.
Nov 16 05:40:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:40:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:40:24 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Instance spawned successfully.
Nov 16 05:40:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:40:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:24 user nova-compute[80928]: INFO nova.compute.manager [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 16 05:40:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:40:24 user nova-compute[80928]: INFO nova.compute.manager [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Took 6.96 seconds to build instance.
Nov 16 05:40:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63198199-6936-4fdb-afc5-8d4e035b6097 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "48435326-337f-4a1f-b213-d6726dc8d874" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.050s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "765e9a3f-b188-483c-b149-2df53766fed8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:40:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:40:29 user nova-compute[80928]: INFO nova.compute.claims [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Claim successful on node user
Nov 16 05:40:30 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG nova.compute.manager [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG nova.compute.manager [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG nova.network.neutron [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:40:30 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:40:30 user nova-compute[80928]: DEBUG nova.compute.manager [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG nova.policy [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b1697de2fd04b27bc89ec6430a8a51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9684eff8dae04ceeb858555284d27e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:40:30 user nova-compute[80928]: INFO nova.virt.block_device [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Booting with volume 0a539086-0cc0-44fc-8cdf-7f4d8e85377d at /dev/vda
Nov 16 05:40:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG os_brick.utils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba4cc22-7285-49ea-9d86-c6510130f2f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d794bf3-c882-4e53-a5dd-e08a99cf73af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6765b40-2c56-40ec-beb4-b8aff95e8d94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd47852c-5bbe-4051-8998-baae8f406892]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:40:30 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:40:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f149d114-22c7-43dd-ba27-8b25149eddf1]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG os_brick.utils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updating existing volume attachment record: 882302d8-d91e-475f-9014-2fd7d5231995 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:40:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:31 user nova-compute[80928]: DEBUG nova.network.neutron [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Successfully created port: a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:40:31 user nova-compute[80928]: DEBUG nova.network.neutron [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Successfully updated port: a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:40:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:40:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquired lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:40:31 user nova-compute[80928]: DEBUG nova.network.neutron [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:40:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-f2ccfe6a-fac2-4d3a-bf3f-d4f2488992ad req-76b857df-8d7f-4486-99d9-6cb70c74773d service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-changed-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-f2ccfe6a-fac2-4d3a-bf3f-d4f2488992ad req-76b857df-8d7f-4486-99d9-6cb70c74773d service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Refreshing instance network info cache due to event network-changed-a88de70f-c14d-47d8-8b55-fd423eece4d6. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:40:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f2ccfe6a-fac2-4d3a-bf3f-d4f2488992ad req-76b857df-8d7f-4486-99d9-6cb70c74773d service nova] Acquiring lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:40:31 user nova-compute[80928]: DEBUG nova.network.neutron [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:40:32 user nova-compute[80928]: DEBUG nova.network.neutron [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updating instance_info_cache with network_info: [{"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:40:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Releasing lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:40:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Instance network_info: |[{"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:40:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f2ccfe6a-fac2-4d3a-bf3f-d4f2488992ad req-76b857df-8d7f-4486-99d9-6cb70c74773d service nova] Acquired lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:40:32 user nova-compute[80928]: DEBUG nova.network.neutron [req-f2ccfe6a-fac2-4d3a-bf3f-d4f2488992ad req-76b857df-8d7f-4486-99d9-6cb70c74773d service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Refreshing network info cache for port a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:40:32 user nova-compute[80928]: DEBUG nova.network.neutron [req-f2ccfe6a-fac2-4d3a-bf3f-d4f2488992ad req-76b857df-8d7f-4486-99d9-6cb70c74773d service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updated VIF entry in instance network info cache for port a88de70f-c14d-47d8-8b55-fd423eece4d6. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:40:32 user nova-compute[80928]: DEBUG nova.network.neutron [req-f2ccfe6a-fac2-4d3a-bf3f-d4f2488992ad req-76b857df-8d7f-4486-99d9-6cb70c74773d service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updating instance_info_cache with network_info: [{"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:40:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f2ccfe6a-fac2-4d3a-bf3f-d4f2488992ad req-76b857df-8d7f-4486-99d9-6cb70c74773d service nova] Releasing lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:40:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:33 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:40:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:33 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:40:33 user nova-compute[80928]: INFO nova.compute.claims [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Claim successful on node user
Nov 16 05:40:34 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:40:34 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:40:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:34 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:40:34 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:40:34 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:40:34 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:40:34 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:40:34 user nova-compute[80928]: INFO nova.virt.block_device [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Booting with volume-backed-image c747fce3-6158-4d78-9cb4-34afacae8f7a at /dev/vda
Nov 16 05:40:34 user nova-compute[80928]: DEBUG nova.policy [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bb9af29de44488282666171f2bcad47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995121e71e234f60b7f7d5ac0abcc0f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:40:35 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Successfully created port: 1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:40:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:35 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Successfully updated port: 1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:40:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "refresh_cache-0a2fc694-8d82-4f4b-971d-18454c975fcd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:40:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquired lock "refresh_cache-0a2fc694-8d82-4f4b-971d-18454c975fcd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:40:35 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:40:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-8dbba174-0f04-4025-b52d-c99e003a9a36 req-6536bc47-dcbc-43a8-9e0b-92229418a140 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-changed-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-8dbba174-0f04-4025-b52d-c99e003a9a36 req-6536bc47-dcbc-43a8-9e0b-92229418a140 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Refreshing instance network info cache due to event network-changed-1db814a1-9a0c-47e2-9e29-5e7616a8156c. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:40:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8dbba174-0f04-4025-b52d-c99e003a9a36 req-6536bc47-dcbc-43a8-9e0b-92229418a140 service nova] Acquiring lock "refresh_cache-0a2fc694-8d82-4f4b-971d-18454c975fcd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:40:35 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Updating instance_info_cache with network_info: [{"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Releasing lock "refresh_cache-0a2fc694-8d82-4f4b-971d-18454c975fcd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Instance network_info: |[{"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8dbba174-0f04-4025-b52d-c99e003a9a36 req-6536bc47-dcbc-43a8-9e0b-92229418a140 service nova] Acquired lock "refresh_cache-0a2fc694-8d82-4f4b-971d-18454c975fcd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.network.neutron [req-8dbba174-0f04-4025-b52d-c99e003a9a36 req-6536bc47-dcbc-43a8-9e0b-92229418a140 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Refreshing network info cache for port 1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:40:36 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Creating image(s)
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Ensure instance console log exists: /opt/stack/data/nova/instances/765e9a3f-b188-483c-b149-2df53766fed8/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Start _get_guest_xml network_info=[{"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVwTftrU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '765e9a3f-b188-483c-b149-2df53766fed8', 'attached_at': '', 'detached_at': '', 'volume_id': '0a539086-0cc0-44fc-8cdf-7f4d8e85377d', 'serial': '0a539086-0cc0-44fc-8cdf-7f4d8e85377d'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '882302d8-d91e-475f-9014-2fd7d5231995', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:40:36 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:40:36 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVwTftrU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:40:36 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:40:36 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.085s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:40:36 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.network.neutron [req-8dbba174-0f04-4025-b52d-c99e003a9a36 req-6536bc47-dcbc-43a8-9e0b-92229418a140 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Updated VIF entry in instance network info cache for port 1db814a1-9a0c-47e2-9e29-5e7616a8156c. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG nova.network.neutron [req-8dbba174-0f04-4025-b52d-c99e003a9a36 req-6536bc47-dcbc-43a8-9e0b-92229418a140 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Updating instance_info_cache with network_info: [{"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260" returned: 21 in 0.139s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9f6c83-c1c2-4aa1-b62c-5ed18b0a4eb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:40:36 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8dbba174-0f04-4025-b52d-c99e003a9a36 req-6536bc47-dcbc-43a8-9e0b-92229418a140 service nova] Releasing lock "refresh_cache-0a2fc694-8d82-4f4b-971d-18454c975fcd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4126498e-42c0-48b4-b756-9ed7bad8416a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d] added
Nov 16 05:40:36 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[534c7f42-1659-4bfc-aa58-045ebcedb612]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d1715b-7700-4cc3-8d19-a3c876629dd8]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MVwTftrU {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MVwTftrU" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b448e9bd-a514-41f8-b400-6b7181a3f4f0]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MVwTftrU'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[734abc30-c769-43db-8315-34b8bcad9736]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7fd981-3a00-4fd2-8f87-8735942d2e29]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:36 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:36 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:40:36 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:36 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:36 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:40:36 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:40:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[21402e01-a493-4702-ae7c-c972b7d40337]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260]
Nov 16 05:40:37 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260] successful.
Nov 16 05:40:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[46188bd3-d72a-41f3-9c0d-76b9ced66820]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[949d9e16-7196-4058-b588-ed96d76aba24]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:37 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:37 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:40:37 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:40:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:37 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:37 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:40:37 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:40:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de99a34-810f-49ce-b7e0-70b722fe7c85]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:40:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVwTftrU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.574s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== connect_volume: return (1576ms) {'type': 'block', 'scsi_wwn': '23937616539363864', 'path': '/dev/sde'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937616539363864', 'path': '/dev/sde'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-171787261',display_name='tempest-ServerActionsTestOtherA-server-171787261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-171787261',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIRZfEcvuwNYhj/y1xM6mcxohhx0m8ZHaUgJiSsxMQwSOGLIDwHJFsK0QD5y79ZqmyvT9tlBnMJypgzLM6OAyjdPrnmqxNSLqGp1Mi6dH0+QoZTXMm8gRWHjmecV7kNjw==',key_name='tempest-keypair-1523932878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-he6qqyb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:40:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=765e9a3f-b188-483c-b149-2df53766fed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG nova.objects.instance [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lazy-loading 'pci_devices' on Instance uuid 765e9a3f-b188-483c-b149-2df53766fed8 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:40:38 user nova-compute[80928]:   <uuid>765e9a3f-b188-483c-b149-2df53766fed8</uuid>
Nov 16 05:40:38 user nova-compute[80928]:   <name>instance-0000001e</name>
Nov 16 05:40:38 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:40:38 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:40:38 user nova-compute[80928]:   <metadata>
Nov 16 05:40:38 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:40:38 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:40:38 user nova-compute[80928]:       <nova:name>tempest-ServerActionsTestOtherA-server-171787261</nova:name>
Nov 16 05:40:38 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:40:36</nova:creationTime>
Nov 16 05:40:38 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:40:38 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:40:38 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:40:38 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:40:38 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:40:38 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:40:38 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:40:38 user nova-compute[80928]:       <nova:owner>
Nov 16 05:40:38 user nova-compute[80928]:         <nova:user uuid="6b1697de2fd04b27bc89ec6430a8a51d">tempest-ServerActionsTestOtherA-1550926993-project-member</nova:user>
Nov 16 05:40:38 user nova-compute[80928]:         <nova:project uuid="9684eff8dae04ceeb858555284d27e39">tempest-ServerActionsTestOtherA-1550926993</nova:project>
Nov 16 05:40:38 user nova-compute[80928]:       </nova:owner>
Nov 16 05:40:38 user nova-compute[80928]:       <nova:ports>
Nov 16 05:40:38 user nova-compute[80928]:         <nova:port uuid="a88de70f-c14d-47d8-8b55-fd423eece4d6">
Nov 16 05:40:38 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:40:38 user nova-compute[80928]:         </nova:port>
Nov 16 05:40:38 user nova-compute[80928]:       </nova:ports>
Nov 16 05:40:38 user nova-compute[80928]:     </nova:instance>
Nov 16 05:40:38 user nova-compute[80928]:   </metadata>
Nov 16 05:40:38 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:40:38 user nova-compute[80928]:     <system>
Nov 16 05:40:38 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:40:38 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:40:38 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:40:38 user nova-compute[80928]:       <entry name="serial">765e9a3f-b188-483c-b149-2df53766fed8</entry>
Nov 16 05:40:38 user nova-compute[80928]:       <entry name="uuid">765e9a3f-b188-483c-b149-2df53766fed8</entry>
Nov 16 05:40:38 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:40:38 user nova-compute[80928]:     </system>
Nov 16 05:40:38 user nova-compute[80928]:   </sysinfo>
Nov 16 05:40:38 user nova-compute[80928]:   <os>
Nov 16 05:40:38 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:40:38 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:40:38 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:40:38 user nova-compute[80928]:   </os>
Nov 16 05:40:38 user nova-compute[80928]:   <features>
Nov 16 05:40:38 user nova-compute[80928]:     <acpi/>
Nov 16 05:40:38 user nova-compute[80928]:     <apic/>
Nov 16 05:40:38 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:40:38 user nova-compute[80928]:   </features>
Nov 16 05:40:38 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:40:38 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:40:38 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:40:38 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:40:38 user nova-compute[80928]:   </clock>
Nov 16 05:40:38 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:40:38 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:40:38 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:40:38 user nova-compute[80928]:   </cpu>
Nov 16 05:40:38 user nova-compute[80928]:   <devices>
Nov 16 05:40:38 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:40:38 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:40:38 user nova-compute[80928]:       <source dev="/dev/sde"/>
Nov 16 05:40:38 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:40:38 user nova-compute[80928]:       <serial>0a539086-0cc0-44fc-8cdf-7f4d8e85377d</serial>
Nov 16 05:40:38 user nova-compute[80928]:     </disk>
Nov 16 05:40:38 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:40:38 user nova-compute[80928]:       <mac address="fa:16:3e:2c:8f:a2"/>
Nov 16 05:40:38 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:40:38 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:40:38 user nova-compute[80928]:       <target dev="tapa88de70f-c1"/>
Nov 16 05:40:38 user nova-compute[80928]:     </interface>
Nov 16 05:40:38 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:40:38 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/765e9a3f-b188-483c-b149-2df53766fed8/console.log" append="off"/>
Nov 16 05:40:38 user nova-compute[80928]:     </serial>
Nov 16 05:40:38 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:40:38 user nova-compute[80928]:     <video>
Nov 16 05:40:38 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:40:38 user nova-compute[80928]:     </video>
Nov 16 05:40:38 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:40:38 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:40:38 user nova-compute[80928]:     </rng>
Nov 16 05:40:38 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:40:38 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:40:38 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:40:38 user nova-compute[80928]:     </memballoon>
Nov 16 05:40:38 user nova-compute[80928]:   </devices>
Nov 16 05:40:38 user nova-compute[80928]: </domain>
Nov 16 05:40:38 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-171787261',display_name='tempest-ServerActionsTestOtherA-server-171787261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-171787261',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIRZfEcvuwNYhj/y1xM6mcxohhx0m8ZHaUgJiSsxMQwSOGLIDwHJFsK0QD5y79ZqmyvT9tlBnMJypgzLM6OAyjdPrnmqxNSLqGp1Mi6dH0+QoZTXMm8gRWHjmecV7kNjw==',key_name='tempest-keypair-1523932878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-he6qqyb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:40:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=765e9a3f-b188-483c-b149-2df53766fed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG os_vif [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5dead64-41c0-5c12-86e6-dd5ac45d860f', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa88de70f-c1, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa88de70f-c1, col_values=(('qos', UUID('a3eb369a-13b4-45b9-88a9-06a9f5189fc4')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa88de70f-c1, col_values=(('external_ids', {'iface-id': 'a88de70f-c14d-47d8-8b55-fd423eece4d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:8f:a2', 'vm-uuid': '765e9a3f-b188-483c-b149-2df53766fed8'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:38 user nova-compute[80928]: INFO os_vif [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1')
Nov 16 05:40:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:40:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No VIF found with MAC fa:16:3e:2c:8f:a2, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:40:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-9c44c554-3e65-4e4e-bab9-28bca1340d6f req-9fc24864-eff3-43e2-8aae-d336ca888e41 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9c44c554-3e65-4e4e-bab9-28bca1340d6f req-9fc24864-eff3-43e2-8aae-d336ca888e41 service nova] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9c44c554-3e65-4e4e-bab9-28bca1340d6f req-9fc24864-eff3-43e2-8aae-d336ca888e41 service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9c44c554-3e65-4e4e-bab9-28bca1340d6f req-9fc24864-eff3-43e2-8aae-d336ca888e41 service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-9c44c554-3e65-4e4e-bab9-28bca1340d6f req-9fc24864-eff3-43e2-8aae-d336ca888e41 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] No waiting events found dispatching network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:40:39 user nova-compute[80928]: WARNING nova.compute.manager [req-9c44c554-3e65-4e4e-bab9-28bca1340d6f req-9fc24864-eff3-43e2-8aae-d336ca888e41 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received unexpected event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 for instance with vm_state building and task_state spawning.
Nov 16 05:40:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG os_brick.utils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[592c4012-b8d1-4a59-902b-d99935460ee3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fedcb03-a48a-444a-8342-c4657fbabb70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[02641ad9-d3aa-4a98-96be-5c6a66a4126f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[244d64f4-f78a-4126-97a8-035b37a1cc8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:40:40 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:40:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[077c34b7-88a1-46ed-88fe-1037b8f405fb]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG os_brick.utils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Updating existing volume attachment record: 764d4fe8-59d6-4592-a38a-fb3ae8a8405d {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:40:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG nova.compute.manager [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:40:41 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Instance spawned successfully.
Nov 16 05:40:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:41 user nova-compute[80928]: INFO nova.compute.manager [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 16 05:40:41 user nova-compute[80928]: DEBUG nova.compute.manager [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-c5ec6bb0-dc9e-44ec-a760-8ae903362b7e req-c2b71361-4bc1-44d5-9748-450b11cb750a service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c5ec6bb0-dc9e-44ec-a760-8ae903362b7e req-c2b71361-4bc1-44d5-9748-450b11cb750a service nova] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c5ec6bb0-dc9e-44ec-a760-8ae903362b7e req-c2b71361-4bc1-44d5-9748-450b11cb750a service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c5ec6bb0-dc9e-44ec-a760-8ae903362b7e req-c2b71361-4bc1-44d5-9748-450b11cb750a service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-c5ec6bb0-dc9e-44ec-a760-8ae903362b7e req-c2b71361-4bc1-44d5-9748-450b11cb750a service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] No waiting events found dispatching network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:40:41 user nova-compute[80928]: WARNING nova.compute.manager [req-c5ec6bb0-dc9e-44ec-a760-8ae903362b7e req-c2b71361-4bc1-44d5-9748-450b11cb750a service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received unexpected event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 for instance with vm_state building and task_state spawning.
Nov 16 05:40:41 user nova-compute[80928]: INFO nova.compute.manager [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Took 12.10 seconds to build instance.
Nov 16 05:40:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-13d32e2b-9d22-44f4-9876-f522bfb56636 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "765e9a3f-b188-483c-b149-2df53766fed8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.200s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:40:45 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Creating image(s)
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Ensure instance console log exists: /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Start _get_guest_xml network_info=[{"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDciazuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a2fc694-8d82-4f4b-971d-18454c975fcd', 'attached_at': '', 'detached_at': '', 'volume_id': '18b5e9d1-d53f-4270-9e0f-af1302953f1d', 'serial': '18b5e9d1-d53f-4270-9e0f-af1302953f1d'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '764d4fe8-59d6-4592-a38a-fb3ae8a8405d', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:40:45 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:40:45 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDciazuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:40:45 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:40:45 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:40:45 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5d6a7f-90e4-476d-9847-0516a2513c78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:40:45 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[90323dd3-4fb0-4c03-9567-bc73aaec1985]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d] added
Nov 16 05:40:45 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c749780-7057-40bc-bbc0-372949694f73]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[89da18b0-04e0-4142-b760-69960ba0949c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hDciazuo {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hDciazuo" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c843f3-77e2-4f17-a516-1ee195c8370d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hDciazuo'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c32213-008a-4398-a853-6631ef751c99]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a26cc8-d2a0-48d0-a4a7-fbafab1c6134]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:40:45 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:40:45 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e1c31a-b9b1-446f-9653-52a64d34bead]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d, portal: 172.16.0.220,3260]
Nov 16 05:40:45 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d, portal: 172.16.0.220,3260] successful.
Nov 16 05:40:45 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e4fa00-3cb5-4986-8748-2337171f7cb5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc02f422-e26a-4cc7-bca7-3c010e890444]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:40:45 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:40:45 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:40:45 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f10689a-f3d3-4988-a447-aafeb845372d]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDciazuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:40:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23565333536613337', 'path': '/dev/sdf'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565333536613337', 'path': '/dev/sdf'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1390268242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1390268242',id=31,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-en9b6r0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:40:34Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=0a2fc694-8d82-4f4b-971d-18454c975fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:91:f4,bridge_name='br-int',has_traffic_filtering=True,id=1db814a1-9a0c-47e2-9e29-5e7616a8156c,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db814a1-9a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG nova.objects.instance [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a2fc694-8d82-4f4b-971d-18454c975fcd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:40:46 user nova-compute[80928]:   <uuid>0a2fc694-8d82-4f4b-971d-18454c975fcd</uuid>
Nov 16 05:40:46 user nova-compute[80928]:   <name>instance-0000001f</name>
Nov 16 05:40:46 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:40:46 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:40:46 user nova-compute[80928]:   <metadata>
Nov 16 05:40:46 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:40:46 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:40:46 user nova-compute[80928]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1390268242</nova:name>
Nov 16 05:40:46 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:40:45</nova:creationTime>
Nov 16 05:40:46 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:40:46 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:40:46 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:40:46 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:40:46 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:40:46 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:40:46 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:40:46 user nova-compute[80928]:       <nova:owner>
Nov 16 05:40:46 user nova-compute[80928]:         <nova:user uuid="3bb9af29de44488282666171f2bcad47">tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member</nova:user>
Nov 16 05:40:46 user nova-compute[80928]:         <nova:project uuid="995121e71e234f60b7f7d5ac0abcc0f1">tempest-ServerBootFromVolumeStableRescueTest-1026359285</nova:project>
Nov 16 05:40:46 user nova-compute[80928]:       </nova:owner>
Nov 16 05:40:46 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:40:46 user nova-compute[80928]:       <nova:ports>
Nov 16 05:40:46 user nova-compute[80928]:         <nova:port uuid="1db814a1-9a0c-47e2-9e29-5e7616a8156c">
Nov 16 05:40:46 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 05:40:46 user nova-compute[80928]:         </nova:port>
Nov 16 05:40:46 user nova-compute[80928]:       </nova:ports>
Nov 16 05:40:46 user nova-compute[80928]:     </nova:instance>
Nov 16 05:40:46 user nova-compute[80928]:   </metadata>
Nov 16 05:40:46 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:40:46 user nova-compute[80928]:     <system>
Nov 16 05:40:46 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:40:46 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:40:46 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:40:46 user nova-compute[80928]:       <entry name="serial">0a2fc694-8d82-4f4b-971d-18454c975fcd</entry>
Nov 16 05:40:46 user nova-compute[80928]:       <entry name="uuid">0a2fc694-8d82-4f4b-971d-18454c975fcd</entry>
Nov 16 05:40:46 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:40:46 user nova-compute[80928]:     </system>
Nov 16 05:40:46 user nova-compute[80928]:   </sysinfo>
Nov 16 05:40:46 user nova-compute[80928]:   <os>
Nov 16 05:40:46 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:40:46 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:40:46 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:40:46 user nova-compute[80928]:   </os>
Nov 16 05:40:46 user nova-compute[80928]:   <features>
Nov 16 05:40:46 user nova-compute[80928]:     <acpi/>
Nov 16 05:40:46 user nova-compute[80928]:     <apic/>
Nov 16 05:40:46 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:40:46 user nova-compute[80928]:   </features>
Nov 16 05:40:46 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:40:46 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:40:46 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:40:46 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:40:46 user nova-compute[80928]:   </clock>
Nov 16 05:40:46 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:40:46 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:40:46 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:40:46 user nova-compute[80928]:   </cpu>
Nov 16 05:40:46 user nova-compute[80928]:   <devices>
Nov 16 05:40:46 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:40:46 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:40:46 user nova-compute[80928]:       <source dev="/dev/sdf"/>
Nov 16 05:40:46 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:40:46 user nova-compute[80928]:       <serial>18b5e9d1-d53f-4270-9e0f-af1302953f1d</serial>
Nov 16 05:40:46 user nova-compute[80928]:     </disk>
Nov 16 05:40:46 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:40:46 user nova-compute[80928]:       <mac address="fa:16:3e:57:91:f4"/>
Nov 16 05:40:46 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:40:46 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:40:46 user nova-compute[80928]:       <target dev="tap1db814a1-9a"/>
Nov 16 05:40:46 user nova-compute[80928]:     </interface>
Nov 16 05:40:46 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:40:46 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/console.log" append="off"/>
Nov 16 05:40:46 user nova-compute[80928]:     </serial>
Nov 16 05:40:46 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:40:46 user nova-compute[80928]:     <video>
Nov 16 05:40:46 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:40:46 user nova-compute[80928]:     </video>
Nov 16 05:40:46 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:40:46 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:40:46 user nova-compute[80928]:     </rng>
Nov 16 05:40:46 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:40:46 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:40:46 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:40:46 user nova-compute[80928]:     </memballoon>
Nov 16 05:40:46 user nova-compute[80928]:   </devices>
Nov 16 05:40:46 user nova-compute[80928]: </domain>
Nov 16 05:40:46 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1390268242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1390268242',id=31,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-en9b6r0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:40:34Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=0a2fc694-8d82-4f4b-971d-18454c975fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:91:f4,bridge_name='br-int',has_traffic_filtering=True,id=1db814a1-9a0c-47e2-9e29-5e7616a8156c,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db814a1-9a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG os_vif [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:91:f4,bridge_name='br-int',has_traffic_filtering=True,id=1db814a1-9a0c-47e2-9e29-5e7616a8156c,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db814a1-9a') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3ad0d00-157f-5385-8117-491ca4a996f7', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1db814a1-9a, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1db814a1-9a, col_values=(('qos', UUID('10188fa6-80a3-4666-b5a8-e5d1108ff7d8')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1db814a1-9a, col_values=(('external_ids', {'iface-id': '1db814a1-9a0c-47e2-9e29-5e7616a8156c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:91:f4', 'vm-uuid': '0a2fc694-8d82-4f4b-971d-18454c975fcd'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:46 user nova-compute[80928]: INFO os_vif [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:91:f4,bridge_name='br-int',has_traffic_filtering=True,id=1db814a1-9a0c-47e2-9e29-5e7616a8156c,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db814a1-9a')
Nov 16 05:40:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:40:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No VIF found with MAC fa:16:3e:57:91:f4, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:40:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-2b5881d0-48fb-4c4b-8e69-334e531546d2 req-f82cd77e-8cec-4e43-a803-7ea184de217e service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2b5881d0-48fb-4c4b-8e69-334e531546d2 req-f82cd77e-8cec-4e43-a803-7ea184de217e service nova] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2b5881d0-48fb-4c4b-8e69-334e531546d2 req-f82cd77e-8cec-4e43-a803-7ea184de217e service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2b5881d0-48fb-4c4b-8e69-334e531546d2 req-f82cd77e-8cec-4e43-a803-7ea184de217e service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-2b5881d0-48fb-4c4b-8e69-334e531546d2 req-f82cd77e-8cec-4e43-a803-7ea184de217e service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] No waiting events found dispatching network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:40:48 user nova-compute[80928]: WARNING nova.compute.manager [req-2b5881d0-48fb-4c4b-8e69-334e531546d2 req-f82cd77e-8cec-4e43-a803-7ea184de217e service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received unexpected event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c for instance with vm_state building and task_state spawning.
Nov 16 05:40:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:40:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Instance spawned successfully.
Nov 16 05:40:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-bbfc65e8-ce6f-4a33-94e4-7d6738ec355a req-a22b8d0b-a957-449e-bc41-e0bb9ddef674 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bbfc65e8-ce6f-4a33-94e4-7d6738ec355a req-a22b8d0b-a957-449e-bc41-e0bb9ddef674 service nova] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bbfc65e8-ce6f-4a33-94e4-7d6738ec355a req-a22b8d0b-a957-449e-bc41-e0bb9ddef674 service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bbfc65e8-ce6f-4a33-94e4-7d6738ec355a req-a22b8d0b-a957-449e-bc41-e0bb9ddef674 service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-bbfc65e8-ce6f-4a33-94e4-7d6738ec355a req-a22b8d0b-a957-449e-bc41-e0bb9ddef674 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] No waiting events found dispatching network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:40:50 user nova-compute[80928]: WARNING nova.compute.manager [req-bbfc65e8-ce6f-4a33-94e4-7d6738ec355a req-a22b8d0b-a957-449e-bc41-e0bb9ddef674 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received unexpected event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c for instance with vm_state building and task_state spawning.
Nov 16 05:40:50 user nova-compute[80928]: INFO nova.compute.manager [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 16 05:40:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:40:50 user nova-compute[80928]: INFO nova.compute.manager [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Took 16.90 seconds to build instance.
Nov 16 05:40:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d74b07b6-81df-4a3b-905a-bcd22f40a7cf tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.011s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:40:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:40:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:40:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:40:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:41:00 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:41:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:41:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:41:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:41:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:41:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:41:02 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:41:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:41:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:41:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:41:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:41:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:07 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:41:07 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7367MB free_disk=25.155414581298828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance c5ae2c42-de68-4619-96a1-643755597b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 310c7fc9-af32-42dd-be30-8460daa03279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 01efd111-31ef-415e-aeb9-a87bb5d6e33b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 48435326-337f-4a1f-b213-d6726dc8d874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 765e9a3f-b188-483c-b149-2df53766fed8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 0a2fc694-8d82-4f4b-971d-18454c975fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:41:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:41:08 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:41:08 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:41:08 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:41:09 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 05:41:09 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:41:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:09 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:41:09 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:41:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-5f838515-2530-41ff-8a95-118f08c64596 req-62188bcd-1e53-4b03-ace9-548dd79752c3 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received event network-changed-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:41:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-5f838515-2530-41ff-8a95-118f08c64596 req-62188bcd-1e53-4b03-ace9-548dd79752c3 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Refreshing instance network info cache due to event network-changed-4c9af068-8329-4b75-8da2-e59e199a8464. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:41:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5f838515-2530-41ff-8a95-118f08c64596 req-62188bcd-1e53-4b03-ace9-548dd79752c3 service nova] Acquiring lock "refresh_cache-01efd111-31ef-415e-aeb9-a87bb5d6e33b" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:41:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5f838515-2530-41ff-8a95-118f08c64596 req-62188bcd-1e53-4b03-ace9-548dd79752c3 service nova] Acquired lock "refresh_cache-01efd111-31ef-415e-aeb9-a87bb5d6e33b" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:41:15 user nova-compute[80928]: DEBUG nova.network.neutron [req-5f838515-2530-41ff-8a95-118f08c64596 req-62188bcd-1e53-4b03-ace9-548dd79752c3 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Refreshing network info cache for port 4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:41:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:16 user nova-compute[80928]: DEBUG nova.network.neutron [req-5f838515-2530-41ff-8a95-118f08c64596 req-62188bcd-1e53-4b03-ace9-548dd79752c3 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Updated VIF entry in instance network info cache for port 4c9af068-8329-4b75-8da2-e59e199a8464. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:41:16 user nova-compute[80928]: DEBUG nova.network.neutron [req-5f838515-2530-41ff-8a95-118f08c64596 req-62188bcd-1e53-4b03-ace9-548dd79752c3 service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Updating instance_info_cache with network_info: [{"id": "4c9af068-8329-4b75-8da2-e59e199a8464", "address": "fa:16:3e:87:f6:8a", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9af068-83", "ovs_interfaceid": "4c9af068-8329-4b75-8da2-e59e199a8464", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:41:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5f838515-2530-41ff-8a95-118f08c64596 req-62188bcd-1e53-4b03-ace9-548dd79752c3 service nova] Releasing lock "refresh_cache-01efd111-31ef-415e-aeb9-a87bb5d6e33b" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:41:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'flavor' on Instance uuid 01efd111-31ef-415e-aeb9-a87bb5d6e33b {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:41:19 user nova-compute[80928]: INFO nova.compute.manager [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Attaching volume 523c339b-4341-42f8-b7e7-516733fbc987 to /dev/vdb
Nov 16 05:41:19 user nova-compute[80928]: DEBUG os_brick.utils [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[379ec765-734f-4e37-9020-44785a347fe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b73d91-cc5b-4964-a3e0-8c3c9b96917d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa915362-6269-444d-9f4a-c3066cc06e96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1130ac4-86e9-4529-bb97-c113726180b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:41:19 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:41:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[716f0c9c-4d5c-43d8-a59e-fa3cc2ddb67a]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG os_brick.utils [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:41:19 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Updating existing volume attachment record: b7dff41e-9d7f-4d8c-a164-85e2502660c1 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:41:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtdmjyDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:41:24 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:41:24 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:41:24 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fd5a87-d31a-4a8e-98d4-a05917e96b23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:41:24 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0e693f-c482-47e7-8423-d70f4fb8bcd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987] added
Nov 16 05:41:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfe78df-4011-4b5f-841f-f118f54999f8]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94b4a4a-37e1-4dc9-bcbe-5d368509f893]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtdmjyDR {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtdmjyDR" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a842ba34-261c-4222-b6e0-fd65b99375a1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OtdmjyDR'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[54154b8e-1fd3-4cdb-90ab-b87435cc3494]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4491f9ec-683e-42e9-92ee-cb0cf36120b0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:41:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:41:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a703123c-be41-45ba-b267-561ec0793556]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987, portal: 172.16.0.220,3260]
Nov 16 05:41:24 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987, portal: 172.16.0.220,3260] successful.
Nov 16 05:41:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca1b29c-cc3c-4e9d-b475-ce2462251582]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26e1d72-d8af-4c5c-9626-f6230bf9843b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 (non-flash)
Nov 16 05:41:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:41:24 user nova-compute[80928]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 (non-flash)
Nov 16 05:41:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec05904-9c08-4e85-b29d-ffbe181cf341]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:41:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtdmjyDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:41:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:41:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26337633764343838', 'path': '/dev/sdg'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:41:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337633764343838', 'path': '/dev/sdg'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:41:25 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'flavor' on Instance uuid 01efd111-31ef-415e-aeb9-a87bb5d6e33b {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:41:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:41:26 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:41:26 user nova-compute[80928]:   <source dev="/dev/sdg"/>
Nov 16 05:41:26 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:41:26 user nova-compute[80928]:   <serial>523c339b-4341-42f8-b7e7-516733fbc987</serial>
Nov 16 05:41:26 user nova-compute[80928]: </disk>
Nov 16 05:41:26 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:41:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:41:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:41:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] No VIF found with MAC fa:16:3e:87:f6:8a, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:41:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d33bd26-477a-4149-8b13-683006b88f1a tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.887s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:41:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:41:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:41:27 user nova-compute[80928]: INFO nova.compute.manager [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Detaching volume 523c339b-4341-42f8-b7e7-516733fbc987
Nov 16 05:41:27 user nova-compute[80928]: INFO nova.virt.block_device [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Attempting to driver detach volume 523c339b-4341-42f8-b7e7-516733fbc987 from mountpoint /dev/vdb
Nov 16 05:41:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Attempting to detach device vdb from instance 01efd111-31ef-415e-aeb9-a87bb5d6e33b from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:41:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:41:27 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:41:27 user nova-compute[80928]:   <source dev="/dev/sdg"/>
Nov 16 05:41:27 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:41:27 user nova-compute[80928]:   <serial>523c339b-4341-42f8-b7e7-516733fbc987</serial>
Nov 16 05:41:27 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:41:27 user nova-compute[80928]: </disk>
Nov 16 05:41:27 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:41:27 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully detached device vdb from instance 01efd111-31ef-415e-aeb9-a87bb5d6e33b from the persistent domain config.
Nov 16 05:41:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01efd111-31ef-415e-aeb9-a87bb5d6e33b from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:41:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:41:27 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:41:27 user nova-compute[80928]:   <source dev="/dev/sdg"/>
Nov 16 05:41:27 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:41:27 user nova-compute[80928]:   <serial>523c339b-4341-42f8-b7e7-516733fbc987</serial>
Nov 16 05:41:27 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:41:27 user nova-compute[80928]: </disk>
Nov 16 05:41:27 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:41:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01efd111-31ef-415e-aeb9-a87bb5d6e33b {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:41:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:47 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01efd111-31ef-415e-aeb9-a87bb5d6e33b is timed out.
Nov 16 05:41:47 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully detached device vdb from instance 01efd111-31ef-415e-aeb9-a87bb5d6e33b from the live domain config.
Nov 16 05:41:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:41:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtdmjyDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:41:47 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:41:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:41:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:41:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0834737f-ef8d-4d65-8b79-8afb60de9220]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:41:48 user nova-compute[80928]: No targets found.
Nov 16 05:41:48 user nova-compute[80928]: iSNS:
Nov 16 05:41:48 user nova-compute[80928]: No targets found.
Nov 16 05:41:48 user nova-compute[80928]: STATIC:
Nov 16 05:41:48 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13
Nov 16 05:41:48 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:41:48 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:41:48 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987
Nov 16 05:41:48 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:41:48 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:41:48 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d
Nov 16 05:41:48 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:41:48 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:41:48 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b
Nov 16 05:41:48 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:41:48 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:41:48 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:41:48 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:41:48 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:41:48 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d
Nov 16 05:41:48 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:41:48 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:41:48 user nova-compute[80928]: FIRMWARE:
Nov 16 05:41:48 user nova-compute[80928]: No targets found.
Nov 16 05:41:48 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:41:48 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:41:48 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c3163c-2daf-4a44-83dd-775db8ba776e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[576cb791-d63b-4a9d-a82b-75d1c33e39ac]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:41:48 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:41:48 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:41:48 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:41:48 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:41:48 user nova-compute[80928]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 (non-flash)
Nov 16 05:41:48 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:41:48 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:41:48 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:41:48 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:41:48 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:41:48 user nova-compute[80928]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 (non-flash)
Nov 16 05:41:48 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8678126dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987'): ({'sdg'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Removing single pathed devices sdg {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[233dfa25-252d-4693-b809-c55f3f26cb76]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9f93f2-d274-44d4-8c14-76043d267951]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Flushing IO for device /dev/sdg {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[12243441-4584-4747-89db-d365d9761a59]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eaf911-6a87-4a21-86cd-27adf97f9882]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] SCSI volumes sdg have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.132s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7889f825-ac30-4594-bade-3c23dac79cc8]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5cffad-64f7-4eb4-9310-dbd4f7a5afc1]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987, portal: 172.16.0.220,3260]
Nov 16 05:41:48 user nova-compute[80928]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987, portal: 172.16.0.220,3260] successful.
Nov 16 05:41:48 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523c339b-4341-42f8-b7e7-516733fbc987 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d1c29b-a123-4ec7-b1ea-34fe33a16961]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] <== disconnect_volume: return (433ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:41:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:41:49 user nova-compute[80928]: DEBUG nova.objects.instance [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'flavor' on Instance uuid 01efd111-31ef-415e-aeb9-a87bb5d6e33b {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:41:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4bbd552b-649b-4445-a572-d39671f07149 tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.705s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:41:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:41:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:41:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:41:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:41:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:41:52 user nova-compute[80928]: INFO nova.compute.manager [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Terminating instance
Nov 16 05:41:52 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:41:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-156a20b6-7510-490a-876e-ff9b836d58a6 req-e8ee7f20-4015-4f83-a093-c72b417eab4b service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-unplugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-156a20b6-7510-490a-876e-ff9b836d58a6 req-e8ee7f20-4015-4f83-a093-c72b417eab4b service nova] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-156a20b6-7510-490a-876e-ff9b836d58a6 req-e8ee7f20-4015-4f83-a093-c72b417eab4b service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-156a20b6-7510-490a-876e-ff9b836d58a6 req-e8ee7f20-4015-4f83-a093-c72b417eab4b service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-156a20b6-7510-490a-876e-ff9b836d58a6 req-e8ee7f20-4015-4f83-a093-c72b417eab4b service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] No waiting events found dispatching network-vif-unplugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-156a20b6-7510-490a-876e-ff9b836d58a6 req-e8ee7f20-4015-4f83-a093-c72b417eab4b service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-unplugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:41:53 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Instance destroyed successfully.
Nov 16 05:41:53 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lazy-loading 'resources' on Instance uuid 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:33:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1720886813',display_name='tempest-ServerActionsTestOtherB-server-1720886813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1720886813',id=19,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9liT9/8OcIK+JyCDfTMk3trFPyZpf/7B0mBbUikRHMSTPB1lcjCLvTtHnBj5VmxOBF7smgL7oBOajybgsCgVmXQlH849r5LdVXz3wtlHkH2OG/ZZJDnudNBjLF68+HYQ==',key_name='tempest-keypair-454342651',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:39:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a8884142201406a89f46fdfcfb7cb7e',ramdisk_id='',reservation_id='r-0aqy2onj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1064773206',owner_user_name='tempest-ServerActionsTestOtherB-1064773206-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:39:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea9806dcc82048899583dd9f738c109d',uuid=431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converting VIF {"id": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "address": "fa:16:3e:58:5c:e5", "network": {"id": "b0e8fec1-f54e-4672-afb6-c60f0b50fb57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1526085965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8884142201406a89f46fdfcfb7cb7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b5d66c-7f", "ovs_interfaceid": "42b5d66c-7f70-41b3-b29c-58333c62c7f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_vif [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42b5d66c-7f, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15554258-f456-4e40-89e0-0c366d62627e) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:53 user nova-compute[80928]: INFO os_vif [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:5c:e5,bridge_name='br-int',has_traffic_filtering=True,id=42b5d66c-7f70-41b3-b29c-58333c62c7f2,network=Network(b0e8fec1-f54e-4672-afb6-c60f0b50fb57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b5d66c-7f')
Nov 16 05:41:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNroILOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:41:53 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea016ac7-3c8b-4ae5-acd5-3ce8a811a5f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:41:53 user nova-compute[80928]: No targets found.
Nov 16 05:41:53 user nova-compute[80928]: iSNS:
Nov 16 05:41:53 user nova-compute[80928]: No targets found.
Nov 16 05:41:53 user nova-compute[80928]: STATIC:
Nov 16 05:41:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13
Nov 16 05:41:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:41:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:41:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d
Nov 16 05:41:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:41:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:41:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b
Nov 16 05:41:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:41:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:41:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:41:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:41:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:41:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d
Nov 16 05:41:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:41:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:41:53 user nova-compute[80928]: FIRMWARE:
Nov 16 05:41:53 user nova-compute[80928]: No targets found.
Nov 16 05:41:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:41:53 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:41:53 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc8deb4-b41e-4a04-ba48-8538af6c6e3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd2a25d-a120-4e38-ab65-1a702f3cb5e5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:41:53 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:41:53 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:41:53 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:41:53 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:41:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:41:53 user nova-compute[80928]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 (non-flash)
Nov 16 05:41:53 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:41:53 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:41:53 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:41:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a2950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cbc9fd-0406-4e84-878f-c93a8c711890]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1beb33-5aab-4315-88f2-2b116a55ab8c]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb6e0c7-85e9-402d-8081-963b09c8e338]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef079980-63d7-4bd1-9de6-582e6eb7a609]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab88bf8-4ff9-42cb-a051-cf834b21c69b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a4374f-d3a0-4a72-9ad9-372b9829195f]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260]
Nov 16 05:41:53 user nova-compute[80928]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13, portal: 172.16.0.220,3260] successful.
Nov 16 05:41:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:41:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04b116c5-edf0-4afd-b73c-74bef2ce3b13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:41:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02ff71d-282a-4f65-9abd-1430334d5601]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:41:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:41:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:41:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] <== disconnect_volume: return (298ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:41:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:41:54 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Deleting instance files /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc_del
Nov 16 05:41:54 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Deletion of /opt/stack/data/nova/instances/431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc_del complete
Nov 16 05:41:54 user nova-compute[80928]: INFO nova.compute.manager [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 16 05:41:54 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:41:54 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:41:54 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:41:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-21772641-5daf-4814-8993-3f177a6cb524 req-2576e58d-ca64-479b-bbc6-fd2a5c18d4a5 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:41:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-21772641-5daf-4814-8993-3f177a6cb524 req-2576e58d-ca64-479b-bbc6-fd2a5c18d4a5 service nova] Acquiring lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:41:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-21772641-5daf-4814-8993-3f177a6cb524 req-2576e58d-ca64-479b-bbc6-fd2a5c18d4a5 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:41:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-21772641-5daf-4814-8993-3f177a6cb524 req-2576e58d-ca64-479b-bbc6-fd2a5c18d4a5 service nova] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:41:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-21772641-5daf-4814-8993-3f177a6cb524 req-2576e58d-ca64-479b-bbc6-fd2a5c18d4a5 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] No waiting events found dispatching network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:41:55 user nova-compute[80928]: WARNING nova.compute.manager [req-21772641-5daf-4814-8993-3f177a6cb524 req-2576e58d-ca64-479b-bbc6-fd2a5c18d4a5 service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received unexpected event network-vif-plugged-42b5d66c-7f70-41b3-b29c-58333c62c7f2 for instance with vm_state active and task_state deleting.
Nov 16 05:41:55 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:41:55 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Took 1.50 seconds to deallocate network for instance.
Nov 16 05:41:56 user nova-compute[80928]: INFO nova.compute.manager [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Took 0.73 seconds to detach 1 volumes for instance.
Nov 16 05:41:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:41:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:41:56 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:41:56 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:41:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:41:56 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Deleted allocations for instance 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc
Nov 16 05:41:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ee3d9670-e411-4824-8f8a-438632f2a31f tempest-ServerActionsTestOtherB-1064773206 tempest-ServerActionsTestOtherB-1064773206-project-member] Lock "431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:41:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-b32dd92e-5da4-4843-b19b-e3a1b2a2e3f5 req-908c09d5-ee43-4d29-9252-6c88177e0b9c service nova] [instance: 431c9e1e-8fdf-4f81-9ed6-54fda7ec44dc] Received event network-vif-deleted-42b5d66c-7f70-41b3-b29c-58333c62c7f2 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:41:58 user nova-compute[80928]: INFO nova.compute.manager [None req-e4ffc097-335c-4f5a-aabf-79baa21af5b4 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Unrescuing
Nov 16 05:41:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e4ffc097-335c-4f5a-aabf-79baa21af5b4 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:41:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e4ffc097-335c-4f5a-aabf-79baa21af5b4 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquired lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:41:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e4ffc097-335c-4f5a-aabf-79baa21af5b4 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:41:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e4ffc097-335c-4f5a-aabf-79baa21af5b4 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updating instance_info_cache with network_info: [{"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:41:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e4ffc097-335c-4f5a-aabf-79baa21af5b4 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Releasing lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:41:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e4ffc097-335c-4f5a-aabf-79baa21af5b4 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lazy-loading 'flavor' on Instance uuid c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:41:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:41:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:41:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-5bb6e8f4-cbe2-44d9-914a-cf744d13b37a req-fc7ab903-3325-4ea6-81ee-7a6abc6d8a74 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-unplugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:41:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5bb6e8f4-cbe2-44d9-914a-cf744d13b37a req-fc7ab903-3325-4ea6-81ee-7a6abc6d8a74 service nova] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:41:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5bb6e8f4-cbe2-44d9-914a-cf744d13b37a req-fc7ab903-3325-4ea6-81ee-7a6abc6d8a74 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:41:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5bb6e8f4-cbe2-44d9-914a-cf744d13b37a req-fc7ab903-3325-4ea6-81ee-7a6abc6d8a74 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:41:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-5bb6e8f4-cbe2-44d9-914a-cf744d13b37a req-fc7ab903-3325-4ea6-81ee-7a6abc6d8a74 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] No waiting events found dispatching network-vif-unplugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:41:59 user nova-compute[80928]: WARNING nova.compute.manager [req-5bb6e8f4-cbe2-44d9-914a-cf744d13b37a req-fc7ab903-3325-4ea6-81ee-7a6abc6d8a74 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received unexpected event network-vif-unplugged-c5104be0-b766-4a44-807e-b82c40dadbd7 for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:41:59 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Instance destroyed successfully.
Nov 16 05:42:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:00 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:42:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] No waiting events found dispatching network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:01 user nova-compute[80928]: WARNING nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received unexpected event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:42:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-changed-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Refreshing instance network info cache due to event network-changed-c5104be0-b766-4a44-807e-b82c40dadbd7. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:42:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Acquiring lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:42:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Acquired lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:42:01 user nova-compute[80928]: DEBUG nova.network.neutron [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Refreshing network info cache for port c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG nova.network.neutron [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updated VIF entry in instance network info cache for port c5104be0-b766-4a44-807e-b82c40dadbd7. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG nova.network.neutron [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updating instance_info_cache with network_info: [{"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Releasing lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-changed-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Refreshing instance network info cache due to event network-changed-c5104be0-b766-4a44-807e-b82c40dadbd7. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Acquiring lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Acquired lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG nova.network.neutron [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Refreshing network info cache for port c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG nova.network.neutron [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updated VIF entry in instance network info cache for port c5104be0-b766-4a44-807e-b82c40dadbd7. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG nova.network.neutron [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updating instance_info_cache with network_info: [{"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Releasing lock "refresh_cache-c5ae2c42-de68-4619-96a1-643755597b99" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] No waiting events found dispatching network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:02 user nova-compute[80928]: WARNING nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received unexpected event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:42:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] No waiting events found dispatching network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:02 user nova-compute[80928]: WARNING nova.compute.manager [req-fe110f44-759f-4ff3-bcd1-ee6a396ad491 req-6341e740-793d-49ea-b031-e2d65b858feb service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received unexpected event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:42:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:42:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e4ffc097-335c-4f5a-aabf-79baa21af5b4 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:42:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:03 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:42:04 user nova-compute[80928]: INFO nova.compute.manager [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Rescuing
Nov 16 05:42:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquired lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Updating instance_info_cache with network_info: [{"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Releasing lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-4f720840-dda1-4cc3-bcaf-2499df04d98c req-77c761ec-c0c9-4a6f-9be7-44b48cf50b62 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-unplugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4f720840-dda1-4cc3-bcaf-2499df04d98c req-77c761ec-c0c9-4a6f-9be7-44b48cf50b62 service nova] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4f720840-dda1-4cc3-bcaf-2499df04d98c req-77c761ec-c0c9-4a6f-9be7-44b48cf50b62 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4f720840-dda1-4cc3-bcaf-2499df04d98c req-77c761ec-c0c9-4a6f-9be7-44b48cf50b62 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-4f720840-dda1-4cc3-bcaf-2499df04d98c req-77c761ec-c0c9-4a6f-9be7-44b48cf50b62 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] No waiting events found dispatching network-vif-unplugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:04 user nova-compute[80928]: WARNING nova.compute.manager [req-4f720840-dda1-4cc3-bcaf-2499df04d98c req-77c761ec-c0c9-4a6f-9be7-44b48cf50b62 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received unexpected event network-vif-unplugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 for instance with vm_state active and task_state rescuing.
Nov 16 05:42:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:05 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Instance destroyed successfully.
Nov 16 05:42:05 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Attempting rescue
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=80928) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Instance directory exists: not creating {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 05:42:05 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Creating image(s)
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "/opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "/opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4a171080-2c54-4092-902d-7a3f815656b9 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.208s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.rescue {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.rescue" returned: 0 in 0.045s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'migration_context' on Instance uuid 4a171080-2c54-4092-902d-7a3f815656b9 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.objects.base [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<4a171080-2c54-4092-902d-7a3f815656b9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Start _get_guest_xml network_info=[{"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "vif_mac": "fa:16:3e:a4:c7:d5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'resources' on Instance uuid 4a171080-2c54-4092-902d-7a3f815656b9 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.objects.base [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<4a171080-2c54-4092-902d-7a3f815656b9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a171080-2c54-4092-902d-7a3f815656b9 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.objects.base [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<4a171080-2c54-4092-902d-7a3f815656b9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:42:05 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:42:05 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4a171080-2c54-4092-902d-7a3f815656b9 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.objects.base [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<4a171080-2c54-4092-902d-7a3f815656b9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-778331140',display_name='tempest-ServerRescueNegativeTestJSON-server-778331140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-778331140',id=25,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:37:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8820092d2a4d50ab092ac90e5e1d3d',ramdisk_id='',reservation_id='r-uqenc8b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-575506684',owner_user_name='tempest-ServerRescueNegativeTestJSON-575506684-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:37:29Z,user_data=None,user_id='ade947942acc48ef940224970f670985',uuid=4a171080-2c54-4092-902d-7a3f815656b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "vif_mac": "fa:16:3e:a4:c7:d5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converting VIF {"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "vif_mac": "fa:16:3e:a4:c7:d5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:c7:d5,bridge_name='br-int',has_traffic_filtering=True,id=0876efd5-37cf-44b7-b6da-1c02bc4f33b0,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0876efd5-37') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a171080-2c54-4092-902d-7a3f815656b9 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.objects.base [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<4a171080-2c54-4092-902d-7a3f815656b9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:42:05 user nova-compute[80928]:   <uuid>4a171080-2c54-4092-902d-7a3f815656b9</uuid>
Nov 16 05:42:05 user nova-compute[80928]:   <name>instance-00000019</name>
Nov 16 05:42:05 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:42:05 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:42:05 user nova-compute[80928]:   <metadata>
Nov 16 05:42:05 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:42:05 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:42:05 user nova-compute[80928]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-778331140</nova:name>
Nov 16 05:42:05 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:42:05</nova:creationTime>
Nov 16 05:42:05 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:42:05 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:42:05 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:42:05 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:42:05 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:42:05 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:42:05 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:42:05 user nova-compute[80928]:       <nova:owner>
Nov 16 05:42:05 user nova-compute[80928]:         <nova:user uuid="ade947942acc48ef940224970f670985">tempest-ServerRescueNegativeTestJSON-575506684-project-member</nova:user>
Nov 16 05:42:05 user nova-compute[80928]:         <nova:project uuid="bf8820092d2a4d50ab092ac90e5e1d3d">tempest-ServerRescueNegativeTestJSON-575506684</nova:project>
Nov 16 05:42:05 user nova-compute[80928]:       </nova:owner>
Nov 16 05:42:05 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:42:05 user nova-compute[80928]:       <nova:ports>
Nov 16 05:42:05 user nova-compute[80928]:         <nova:port uuid="0876efd5-37cf-44b7-b6da-1c02bc4f33b0">
Nov 16 05:42:05 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:42:05 user nova-compute[80928]:         </nova:port>
Nov 16 05:42:05 user nova-compute[80928]:       </nova:ports>
Nov 16 05:42:05 user nova-compute[80928]:     </nova:instance>
Nov 16 05:42:05 user nova-compute[80928]:   </metadata>
Nov 16 05:42:05 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:42:05 user nova-compute[80928]:     <system>
Nov 16 05:42:05 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:42:05 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:42:05 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:42:05 user nova-compute[80928]:       <entry name="serial">4a171080-2c54-4092-902d-7a3f815656b9</entry>
Nov 16 05:42:05 user nova-compute[80928]:       <entry name="uuid">4a171080-2c54-4092-902d-7a3f815656b9</entry>
Nov 16 05:42:05 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:42:05 user nova-compute[80928]:     </system>
Nov 16 05:42:05 user nova-compute[80928]:   </sysinfo>
Nov 16 05:42:05 user nova-compute[80928]:   <os>
Nov 16 05:42:05 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:42:05 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:42:05 user nova-compute[80928]:   </os>
Nov 16 05:42:05 user nova-compute[80928]:   <features>
Nov 16 05:42:05 user nova-compute[80928]:     <acpi/>
Nov 16 05:42:05 user nova-compute[80928]:     <apic/>
Nov 16 05:42:05 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:42:05 user nova-compute[80928]:   </features>
Nov 16 05:42:05 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:42:05 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:42:05 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:42:05 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:42:05 user nova-compute[80928]:   </clock>
Nov 16 05:42:05 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:42:05 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:42:05 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:42:05 user nova-compute[80928]:   </cpu>
Nov 16 05:42:05 user nova-compute[80928]:   <devices>
Nov 16 05:42:05 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:42:05 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:42:05 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.rescue"/>
Nov 16 05:42:05 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:42:05 user nova-compute[80928]:     </disk>
Nov 16 05:42:05 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:42:05 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:42:05 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk"/>
Nov 16 05:42:05 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:42:05 user nova-compute[80928]:     </disk>
Nov 16 05:42:05 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:42:05 user nova-compute[80928]:       <mac address="fa:16:3e:a4:c7:d5"/>
Nov 16 05:42:05 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:42:05 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:42:05 user nova-compute[80928]:       <target dev="tap0876efd5-37"/>
Nov 16 05:42:05 user nova-compute[80928]:     </interface>
Nov 16 05:42:05 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:42:05 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/console.log" append="off"/>
Nov 16 05:42:05 user nova-compute[80928]:     </serial>
Nov 16 05:42:05 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:42:05 user nova-compute[80928]:     <video>
Nov 16 05:42:05 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:42:05 user nova-compute[80928]:     </video>
Nov 16 05:42:05 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:42:05 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:42:05 user nova-compute[80928]:     </rng>
Nov 16 05:42:05 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:42:05 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:42:05 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:42:05 user nova-compute[80928]:     </memballoon>
Nov 16 05:42:05 user nova-compute[80928]:   </devices>
Nov 16 05:42:05 user nova-compute[80928]: </domain>
Nov 16 05:42:05 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:42:05 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Instance destroyed successfully.
Nov 16 05:42:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No VIF found with MAC fa:16:3e:a4:c7:d5, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:42:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-4afb9d68-ae13-47e3-b3db-0492e670c197 req-ff057398-cacc-4601-a3d0-ddfb47ec46aa service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4afb9d68-ae13-47e3-b3db-0492e670c197 req-ff057398-cacc-4601-a3d0-ddfb47ec46aa service nova] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4afb9d68-ae13-47e3-b3db-0492e670c197 req-ff057398-cacc-4601-a3d0-ddfb47ec46aa service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4afb9d68-ae13-47e3-b3db-0492e670c197 req-ff057398-cacc-4601-a3d0-ddfb47ec46aa service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-4afb9d68-ae13-47e3-b3db-0492e670c197 req-ff057398-cacc-4601-a3d0-ddfb47ec46aa service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] No waiting events found dispatching network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:06 user nova-compute[80928]: WARNING nova.compute.manager [req-4afb9d68-ae13-47e3-b3db-0492e670c197 req-ff057398-cacc-4601-a3d0-ddfb47ec46aa service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received unexpected event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 for instance with vm_state active and task_state rescuing.
Nov 16 05:42:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:42:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] No waiting events found dispatching network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:09 user nova-compute[80928]: WARNING nova.compute.manager [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received unexpected event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 for instance with vm_state active and task_state rescuing.
Nov 16 05:42:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] No waiting events found dispatching network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:09 user nova-compute[80928]: WARNING nova.compute.manager [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received unexpected event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 for instance with vm_state active and task_state rescuing.
Nov 16 05:42:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-changed-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Refreshing instance network info cache due to event network-changed-23245452-d757-4f54-bd1f-ad857f7c25da. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] Acquiring lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] Acquired lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Refreshing network info cache for port 23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Updated VIF entry in instance network info cache for port 23245452-d757-4f54-bd1f-ad857f7c25da. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Updating instance_info_cache with network_info: [{"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-411aa66d-7401-4174-8e63-7aa4134df8ea req-0825e7b6-1b3d-4729-8bc9-6259522ae992 service nova] Releasing lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2107b254-11ca-4a2b-bb52-b01c6daad7d7 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:11 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:42:11 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7714MB free_disk=25.181995391845703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance c5ae2c42-de68-4619-96a1-643755597b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 310c7fc9-af32-42dd-be30-8460daa03279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 01efd111-31ef-415e-aeb9-a87bb5d6e33b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 48435326-337f-4a1f-b213-d6726dc8d874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 765e9a3f-b188-483c-b149-2df53766fed8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 0a2fc694-8d82-4f4b-971d-18454c975fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:42:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "48435326-337f-4a1f-b213-d6726dc8d874" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:12 user nova-compute[80928]: INFO nova.compute.manager [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Shelving
Nov 16 05:42:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG nova.compute.manager [req-e03dbb69-505a-481c-93fb-2b50f1758cbb req-40d48fc7-b037-4265-ab87-4c75ea84ba0b service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-unplugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e03dbb69-505a-481c-93fb-2b50f1758cbb req-40d48fc7-b037-4265-ab87-4c75ea84ba0b service nova] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e03dbb69-505a-481c-93fb-2b50f1758cbb req-40d48fc7-b037-4265-ab87-4c75ea84ba0b service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e03dbb69-505a-481c-93fb-2b50f1758cbb req-40d48fc7-b037-4265-ab87-4c75ea84ba0b service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG nova.compute.manager [req-e03dbb69-505a-481c-93fb-2b50f1758cbb req-40d48fc7-b037-4265-ab87-4c75ea84ba0b service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] No waiting events found dispatching network-vif-unplugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:12 user nova-compute[80928]: WARNING nova.compute.manager [req-e03dbb69-505a-481c-93fb-2b50f1758cbb req-40d48fc7-b037-4265-ab87-4c75ea84ba0b service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received unexpected event network-vif-unplugged-23245452-d757-4f54-bd1f-ad857f7c25da for instance with vm_state active and task_state shelving.
Nov 16 05:42:12 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:42:12 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 8292134f-09d4-4240-94bb-281e6c236d09 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:12 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Instance destroyed successfully.
Nov 16 05:42:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:13 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Beginning cold snapshot process
Nov 16 05:42:13 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:42:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk /opt/stack/data/nova/instances/snapshots/tmpktekjpfg/b60213c2a02447d2a7020625c54b9a4a {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:13 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Updating instance_info_cache with network_info: [{"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:42:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:42:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:42:13 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:42:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:42:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk /opt/stack/data/nova/instances/snapshots/tmpktekjpfg/b60213c2a02447d2a7020625c54b9a4a" returned: 0 in 0.977s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Snapshot extracted, beginning image upload
Nov 16 05:42:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] No waiting events found dispatching network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:14 user nova-compute[80928]: WARNING nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received unexpected event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 05:42:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] No waiting events found dispatching network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:14 user nova-compute[80928]: WARNING nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received unexpected event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 05:42:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] No waiting events found dispatching network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:14 user nova-compute[80928]: WARNING nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received unexpected event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 05:42:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-unplugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] No waiting events found dispatching network-vif-unplugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:14 user nova-compute[80928]: WARNING nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received unexpected event network-vif-unplugged-23245452-d757-4f54-bd1f-ad857f7c25da for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 05:42:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] No waiting events found dispatching network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:14 user nova-compute[80928]: WARNING nova.compute.manager [req-de4ee998-af75-4a1d-a63c-deb9882734dd req-040ccb6f-3701-44bd-8d6e-ef446e22e2be service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received unexpected event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 05:42:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:16 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Snapshot image upload complete
Nov 16 05:42:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:42:17 user nova-compute[80928]: INFO nova.compute.manager [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Shelve offloading
Nov 16 05:42:17 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Instance destroyed successfully.
Nov 16 05:42:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquired lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Updating instance_info_cache with network_info: [{"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Releasing lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:17 user nova-compute[80928]: INFO nova.compute.manager [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Terminating instance
Nov 16 05:42:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Instance destroyed successfully.
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.objects.instance [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'resources' on Instance uuid 48435326-337f-4a1f-b213-d6726dc8d874 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-b6568d7d-1476-4d25-bfa2-6f2773e6ae60 req-8da058d6-61f9-4a45-aaff-5b21d959a59d service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received event network-vif-unplugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6568d7d-1476-4d25-bfa2-6f2773e6ae60 req-8da058d6-61f9-4a45-aaff-5b21d959a59d service nova] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6568d7d-1476-4d25-bfa2-6f2773e6ae60 req-8da058d6-61f9-4a45-aaff-5b21d959a59d service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6568d7d-1476-4d25-bfa2-6f2773e6ae60 req-8da058d6-61f9-4a45-aaff-5b21d959a59d service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-b6568d7d-1476-4d25-bfa2-6f2773e6ae60 req-8da058d6-61f9-4a45-aaff-5b21d959a59d service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] No waiting events found dispatching network-vif-unplugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-b6568d7d-1476-4d25-bfa2-6f2773e6ae60 req-8da058d6-61f9-4a45-aaff-5b21d959a59d service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received event network-vif-unplugged-4c9af068-8329-4b75-8da2-e59e199a8464 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1026899600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1026899600',id=29,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTEsmWvmLnfwWRPHYSw37ebtNtMfKhffLuK4BthyMPgtFmpE97cB9GkBpRVp9gKJTB9uQrQ2oEV9S4BczHv6aMH5QssZrVCQr46XuQS7IOBv81XuBHbCLVnXQmb+RQ0Hg==',key_name='tempest-keypair-851703054',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9efdd13a65f44182a910ecf45bf27116',ramdisk_id='',reservation_id='r-c0ou62pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-658694431',owner_user_name='tempest-AttachVolumeShelveTestJSON-658694431-project-member',shelved_at='2023-11-16T05:42:16.977431',shelved_host='user',shelved_image_id='5ac5ba96-a67b-4e81-9f2e-85f00152b7bc'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:42:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='505358920a9e43c59cf29b85ffbccb95',uuid=48435326-337f-4a1f-b213-d6726dc8d874,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converting VIF {"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG os_vif [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23245452-d7, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ed4362b-06c8-4a87-a886-be33ce01d760) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: INFO os_vif [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7')
Nov 16 05:42:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Deleting instance files /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874_del
Nov 16 05:42:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Deletion of /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874_del complete
Nov 16 05:42:18 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Deleted allocations for instance 48435326-337f-4a1f-b213-d6726dc8d874
Nov 16 05:42:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.objects.instance [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'numa_topology' on Instance uuid 48435326-337f-4a1f-b213-d6726dc8d874 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.objects.base [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Object Instance<48435326-337f-4a1f-b213-d6726dc8d874> lazy-loaded attributes: resources,numa_topology {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Instance destroyed successfully.
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.objects.instance [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lazy-loading 'resources' on Instance uuid 01efd111-31ef-415e-aeb9-a87bb5d6e33b {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1126435101',display_name='tempest-AttachVolumeNegativeTest-server-1126435101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1126435101',id=28,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmhiSFQlKh7qSut4valIfzaukdrv7qM4/gIsKjpGWgtLArdjpY+ZM/7ZhG76Z1Mw3rH3j8IZf/jo+69H2tTF/mIj7njddvIEfZKbLVuS3n3YEHgg+W0j0/3i9eYCnwIuw==',key_name='tempest-keypair-26332102',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f585dcb9e6cb432a9b04526ebc30e9d8',ramdisk_id='',reservation_id='r-l2f0na8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-155531213',owner_user_name='tempest-AttachVolumeNegativeTest-155531213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='952a7ea7e63649259b0b1e0df40c97d0',uuid=01efd111-31ef-415e-aeb9-a87bb5d6e33b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c9af068-8329-4b75-8da2-e59e199a8464", "address": "fa:16:3e:87:f6:8a", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9af068-83", "ovs_interfaceid": "4c9af068-8329-4b75-8da2-e59e199a8464", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converting VIF {"id": "4c9af068-8329-4b75-8da2-e59e199a8464", "address": "fa:16:3e:87:f6:8a", "network": {"id": "65bd86fb-2067-462c-b504-c603e84f8d42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1775476617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f585dcb9e6cb432a9b04526ebc30e9d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c9af068-83", "ovs_interfaceid": "4c9af068-8329-4b75-8da2-e59e199a8464", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:f6:8a,bridge_name='br-int',has_traffic_filtering=True,id=4c9af068-8329-4b75-8da2-e59e199a8464,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9af068-83') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG os_vif [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:f6:8a,bridge_name='br-int',has_traffic_filtering=True,id=4c9af068-8329-4b75-8da2-e59e199a8464,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9af068-83') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c9af068-83, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfb1830d-ce6b-4c73-98a3-c7f841cea64a) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:18 user nova-compute[80928]: INFO os_vif [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:f6:8a,bridge_name='br-int',has_traffic_filtering=True,id=4c9af068-8329-4b75-8da2-e59e199a8464,network=Network(65bd86fb-2067-462c-b504-c603e84f8d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c9af068-83')
Nov 16 05:42:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Deleting instance files /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b_del
Nov 16 05:42:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Deletion of /opt/stack/data/nova/instances/01efd111-31ef-415e-aeb9-a87bb5d6e33b_del complete
Nov 16 05:42:18 user nova-compute[80928]: INFO nova.compute.manager [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 16 05:42:18 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:42:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-01e02249-439f-4075-a560-fa58c487f657 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "48435326-337f-4a1f-b213-d6726dc8d874" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.842s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:19 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:42:19 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Took 1.07 seconds to deallocate network for instance.
Nov 16 05:42:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received event network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] No waiting events found dispatching network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:20 user nova-compute[80928]: WARNING nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received unexpected event network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 for instance with vm_state deleted and task_state None.
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received event network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] No waiting events found dispatching network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:20 user nova-compute[80928]: WARNING nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received unexpected event network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 for instance with vm_state deleted and task_state None.
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received event network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] No waiting events found dispatching network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:20 user nova-compute[80928]: WARNING nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received unexpected event network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 for instance with vm_state deleted and task_state None.
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received event network-vif-unplugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] No waiting events found dispatching network-vif-unplugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:20 user nova-compute[80928]: WARNING nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received unexpected event network-vif-unplugged-4c9af068-8329-4b75-8da2-e59e199a8464 for instance with vm_state deleted and task_state None.
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received event network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Acquiring lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] No waiting events found dispatching network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:20 user nova-compute[80928]: WARNING nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received unexpected event network-vif-plugged-4c9af068-8329-4b75-8da2-e59e199a8464 for instance with vm_state deleted and task_state None.
Nov 16 05:42:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-9910d0a8-521f-4c48-bff3-3747ee8b6185 req-9ecda3dd-5d4f-4824-b425-1e791045f4cc service nova] [instance: 01efd111-31ef-415e-aeb9-a87bb5d6e33b] Received event network-vif-deleted-4c9af068-8329-4b75-8da2-e59e199a8464 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:20 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Deleted allocations for instance 01efd111-31ef-415e-aeb9-a87bb5d6e33b
Nov 16 05:42:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-70e7fd6f-ffcd-42e1-b25e-8d919cad42ee tempest-AttachVolumeNegativeTest-155531213 tempest-AttachVolumeNegativeTest-155531213-project-member] Lock "01efd111-31ef-415e-aeb9-a87bb5d6e33b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.657s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Received event network-changed-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Refreshing instance network info cache due to event network-changed-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:42:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] Acquiring lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:42:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] Acquired lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:42:22 user nova-compute[80928]: DEBUG nova.network.neutron [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Refreshing network info cache for port 9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG nova.compute.manager [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Stashing vm_state: active {{(pid=80928) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updated VIF entry in instance network info cache for port 9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updating instance_info_cache with network_info: [{"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] Releasing lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-changed-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Refreshing instance network info cache due to event network-changed-a88de70f-c14d-47d8-8b55-fd423eece4d6. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] Acquiring lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] Acquired lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Refreshing network info cache for port a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:42:23 user nova-compute[80928]: INFO nova.compute.claims [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Claim successful on node user
Nov 16 05:42:23 user nova-compute[80928]: INFO nova.compute.resource_tracker [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updating resource usage from migration 08f41834-fa95-4095-babf-4b53e74b9cf4
Nov 16 05:42:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.444s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:23 user nova-compute[80928]: INFO nova.compute.manager [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Migrating
Nov 16 05:42:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updated VIF entry in instance network info cache for port a88de70f-c14d-47d8-8b55-fd423eece4d6. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updating instance_info_cache with network_info: [{"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ff337bd3-922e-49d5-b1fe-0644c31e5514 req-6817ab0e-2e25-4ffa-a459-39f5d9a917a4 service nova] Releasing lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquired lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:42:23 user nova-compute[80928]: DEBUG nova.network.neutron [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:42:24 user nova-compute[80928]: INFO nova.compute.manager [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Rescuing
Nov 16 05:42:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "refresh_cache-0a2fc694-8d82-4f4b-971d-18454c975fcd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquired lock "refresh_cache-0a2fc694-8d82-4f4b-971d-18454c975fcd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updating instance_info_cache with network_info: [{"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Releasing lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Starting migrate_disk_and_power_off {{(pid=80928) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Updating instance_info_cache with network_info: [{"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Releasing lock "refresh_cache-0a2fc694-8d82-4f4b-971d-18454c975fcd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-663cf208-6b9b-4e6a-8072-0dba542b00bb req-d89b09fc-8e22-4e2e-b426-503fb239d96c service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-unplugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-663cf208-6b9b-4e6a-8072-0dba542b00bb req-d89b09fc-8e22-4e2e-b426-503fb239d96c service nova] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-663cf208-6b9b-4e6a-8072-0dba542b00bb req-d89b09fc-8e22-4e2e-b426-503fb239d96c service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-663cf208-6b9b-4e6a-8072-0dba542b00bb req-d89b09fc-8e22-4e2e-b426-503fb239d96c service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-663cf208-6b9b-4e6a-8072-0dba542b00bb req-d89b09fc-8e22-4e2e-b426-503fb239d96c service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] No waiting events found dispatching network-vif-unplugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:24 user nova-compute[80928]: WARNING nova.compute.manager [req-663cf208-6b9b-4e6a-8072-0dba542b00bb req-d89b09fc-8e22-4e2e-b426-503fb239d96c service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received unexpected event network-vif-unplugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 for instance with vm_state active and task_state resize_migrating.
Nov 16 05:42:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d57bcd9b-b0a4-4d34-9f52-e4664d2ad93f req-952fe162-eb38-4a2d-920e-9fcdcfc8aa6b service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-unplugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d57bcd9b-b0a4-4d34-9f52-e4664d2ad93f req-952fe162-eb38-4a2d-920e-9fcdcfc8aa6b service nova] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d57bcd9b-b0a4-4d34-9f52-e4664d2ad93f req-952fe162-eb38-4a2d-920e-9fcdcfc8aa6b service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d57bcd9b-b0a4-4d34-9f52-e4664d2ad93f req-952fe162-eb38-4a2d-920e-9fcdcfc8aa6b service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d57bcd9b-b0a4-4d34-9f52-e4664d2ad93f req-952fe162-eb38-4a2d-920e-9fcdcfc8aa6b service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] No waiting events found dispatching network-vif-unplugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:25 user nova-compute[80928]: WARNING nova.compute.manager [req-d57bcd9b-b0a4-4d34-9f52-e4664d2ad93f req-952fe162-eb38-4a2d-920e-9fcdcfc8aa6b service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received unexpected event network-vif-unplugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c for instance with vm_state active and task_state rescuing.
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Instance destroyed successfully.
Nov 16 05:42:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-171787261',display_name='tempest-ServerActionsTestOtherA-server-171787261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-171787261',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIRZfEcvuwNYhj/y1xM6mcxohhx0m8ZHaUgJiSsxMQwSOGLIDwHJFsK0QD5y79ZqmyvT9tlBnMJypgzLM6OAyjdPrnmqxNSLqGp1Mi6dH0+QoZTXMm8gRWHjmecV7kNjw==',key_name='tempest-keypair-1523932878',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:40:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-he6qqyb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=765e9a3f-b188-483c-b149-2df53766fed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-486420499-network", "vif_mac": "fa:16:3e:2c:8f:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-486420499-network", "vif_mac": "fa:16:3e:2c:8f:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG os_vif [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa88de70f-c1, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:42:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Instance destroyed successfully.
Nov 16 05:42:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Attempting a stable device rescue
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3eb369a-13b4-45b9-88a9-06a9f5189fc4) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:25 user nova-compute[80928]: INFO os_vif [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1')
Nov 16 05:42:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVwTftrU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:42:25 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:42:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=80928) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Instance directory exists: not creating {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 05:42:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Creating image(s)
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "/opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "/opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a2fc694-8d82-4f4b-971d-18454c975fcd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e7641b-c9ad-4cbf-a291-2d9aa0c4a55e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:42:25 user nova-compute[80928]: No targets found.
Nov 16 05:42:25 user nova-compute[80928]: iSNS:
Nov 16 05:42:25 user nova-compute[80928]: No targets found.
Nov 16 05:42:25 user nova-compute[80928]: STATIC:
Nov 16 05:42:25 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d
Nov 16 05:42:25 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:42:25 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:42:25 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b
Nov 16 05:42:25 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:42:25 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:42:25 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:42:25 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:42:25 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:42:25 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d
Nov 16 05:42:25 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:42:25 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:42:25 user nova-compute[80928]: FIRMWARE:
Nov 16 05:42:25 user nova-compute[80928]: No targets found.
Nov 16 05:42:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:42:25 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:42:25 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "2143f93bd2eded617112d9a903bc3f1c96fbf244" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "2143f93bd2eded617112d9a903bc3f1c96fbf244" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d44c077-c346-44ae-bef9-afcc5c0cdda9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed936f6-db39-4a49-8455-51a6c9ad78b2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:42:25 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:42:25 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:42:25 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:42:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:42:25 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:42:25 user nova-compute[80928]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:42:25 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:42:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8678124af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d'): ({'sde'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Removing single pathed devices sde {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6db658-11fb-4a89-8d20-5086ef932b43]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244.part --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.032s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d36255c-7216-42da-ac8f-5096c4ca6c8d]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flushing IO for device /dev/sde {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a14cb8a-32a2-4577-8fb0-dd79947808b0]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[85344ea8-c86c-4c52-81a5-0498638a7f39]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] SCSI volumes sde have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7246af3d-7467-4e9c-af0c-9530a373c8b2]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244.part --force-share --output=json" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG nova.virt.images [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] c9220315-89ad-4d03-82ac-89e1117d9aec was qcow2, converting to raw {{(pid=80928) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244.part /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244.converted {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f3d456-a7b8-4dbb-991f-4632336f42a4]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] No waiting events found dispatching network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:26 user nova-compute[80928]: WARNING nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received unexpected event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 for instance with vm_state active and task_state resize_migrating.
Nov 16 05:42:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] No waiting events found dispatching network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:26 user nova-compute[80928]: WARNING nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received unexpected event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 for instance with vm_state active and task_state resize_migrating.
Nov 16 05:42:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] No waiting events found dispatching network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:26 user nova-compute[80928]: WARNING nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received unexpected event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 for instance with vm_state active and task_state resize_migrating.
Nov 16 05:42:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-unplugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] No waiting events found dispatching network-vif-unplugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:27 user nova-compute[80928]: WARNING nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received unexpected event network-vif-unplugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 for instance with vm_state active and task_state resize_migrating.
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] No waiting events found dispatching network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:27 user nova-compute[80928]: WARNING nova.compute.manager [req-262b4ba6-e542-439c-b056-25ed874cd42d req-cdc40143-67b1-4f72-a59c-cf4fcf3138dd service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received unexpected event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 for instance with vm_state active and task_state resize_migrating.
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260]
Nov 16 05:42:27 user nova-compute[80928]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260] successful.
Nov 16 05:42:27 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dd0176-a8fa-4b6e-8415-0d4ecdf7a12d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.371s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== disconnect_volume: return (1372ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-e7e7423d-acbf-4c97-af1f-e859ac0cf711 req-e312e619-7318-4414-8e32-c4a544c5a175 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e7e7423d-acbf-4c97-af1f-e859ac0cf711 req-e312e619-7318-4414-8e32-c4a544c5a175 service nova] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e7e7423d-acbf-4c97-af1f-e859ac0cf711 req-e312e619-7318-4414-8e32-c4a544c5a175 service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e7e7423d-acbf-4c97-af1f-e859ac0cf711 req-e312e619-7318-4414-8e32-c4a544c5a175 service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-e7e7423d-acbf-4c97-af1f-e859ac0cf711 req-e312e619-7318-4414-8e32-c4a544c5a175 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] No waiting events found dispatching network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:27 user nova-compute[80928]: WARNING nova.compute.manager [req-e7e7423d-acbf-4c97-af1f-e859ac0cf711 req-e312e619-7318-4414-8e32-c4a544c5a175 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received unexpected event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c for instance with vm_state active and task_state rescuing.
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244.part /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244.converted" returned: 0 in 0.341s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244.converted --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "2143f93bd2eded617112d9a903bc3f1c96fbf244" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.715s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "2143f93bd2eded617112d9a903bc3f1c96fbf244" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "2143f93bd2eded617112d9a903bc3f1c96fbf244" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244 --force-share --output=json" returned: 0 in 0.168s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244,backing_fmt=raw /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.rescue {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244,backing_fmt=raw /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.rescue" returned: 0 in 0.049s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "2143f93bd2eded617112d9a903bc3f1c96fbf244" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'migration_context' on Instance uuid 0a2fc694-8d82-4f4b-971d-18454c975fcd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.objects.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Object Instance<0a2fc694-8d82-4f4b-971d-18454c975fcd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Start _get_guest_xml network_info=[{"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "vif_mac": "fa:16:3e:57:91:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c9220315-89ad-4d03-82ac-89e1117d9aec', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDciazuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '0a2fc694-8d82-4f4b-971d-18454c975fcd', 'attached_at': '', 'detached_at': '', 'volume_id': '18b5e9d1-d53f-4270-9e0f-af1302953f1d', 'serial': '18b5e9d1-d53f-4270-9e0f-af1302953f1d'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '764d4fe8-59d6-4592-a38a-fb3ae8a8405d', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'resources' on Instance uuid 0a2fc694-8d82-4f4b-971d-18454c975fcd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.objects.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Object Instance<0a2fc694-8d82-4f4b-971d-18454c975fcd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a2fc694-8d82-4f4b-971d-18454c975fcd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.objects.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Object Instance<0a2fc694-8d82-4f4b-971d-18454c975fcd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:42:27 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:42:27 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a2fc694-8d82-4f4b-971d-18454c975fcd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.objects.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Object Instance<0a2fc694-8d82-4f4b-971d-18454c975fcd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDciazuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:42:27 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:42:27 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:42:27 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c4520e-246e-4b68-8ec3-838b2857179a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hDciazuo\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 05:42:27 user nova-compute[80928]: node.name = iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d
Nov 16 05:42:27 user nova-compute[80928]: node.tpgt = -1
Nov 16 05:42:27 user nova-compute[80928]: node.startup = automatic
Nov 16 05:42:27 user nova-compute[80928]: node.leading_login = No
Nov 16 05:42:27 user nova-compute[80928]: iface.iscsi_ifacename = default
Nov 16 05:42:27 user nova-compute[80928]: iface.net_ifacename = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.ipaddress = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.prefix_len = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.hwaddress = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.transport_name = tcp
Nov 16 05:42:27 user nova-compute[80928]: iface.initiatorname = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.state = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.vlan_id = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.vlan_priority = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.vlan_state = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.iface_num = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.mtu = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.port = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.bootproto = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.subnet_mask = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.gateway = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.dhcp_alt_client_id = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.dhcp_dns = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.dhcp_learn_iqn = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.dhcp_vendor_id_state = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.dhcp_vendor_id = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.dhcp_slp_da = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.fragmentation = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.gratuitous_arp = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.incoming_forwarding = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.tos_state = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.tos = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.ttl = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.delayed_ack = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.tcp_nagle = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.tcp_wsf_state = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.tcp_wsf = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.tcp_timer_scale = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.tcp_timestamp = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.redirect = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.def_task_mgmt_timeout = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.header_digest = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.data_digest = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.immediate_data = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.initial_r2t = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.data_seq_inorder = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.data_pdu_inorder = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.erl = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.max_receive_data_len = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.first_burst_len = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.max_outstanding_r2t = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.max_burst_len = 0
Nov 16 05:42:27 user nova-compute[80928]: iface.chap_auth = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.bidi_chap = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.strict_login_compliance = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.discovery_auth = <empty>
Nov 16 05:42:27 user nova-compute[80928]: iface.discovery_logout = <empty>
Nov 16 05:42:27 user nova-compute[80928]: node.discovery_address = <empty>
Nov 16 05:42:27 user nova-compute[80928]: node.discovery_port = 0
Nov 16 05:42:27 user nova-compute[80928]: node.discovery_type = static
Nov 16 05:42:27 user nova-compute[80928]: node.session.initial_cmdsn = 0
Nov 16 05:42:27 user nova-compute[80928]: node.session.initial_login_retry_max = 8
Nov 16 05:42:27 user nova-compute[80928]: node.session.xmit_thread_priority = -20
Nov 16 05:42:27 user nova-compute[80928]: node.session.cmds_max = 128
Nov 16 05:42:27 user nova-compute[80928]: node.session.queue_depth = 32
Nov 16 05:42:27 user nova-compute[80928]: node.session.nr_sessions = 1
Nov 16 05:42:27 user nova-compute[80928]: node.session.auth.authmethod = CHAP
Nov 16 05:42:27 user nova-compute[80928]: node.session.auth.username = hDciazuo
Nov 16 05:42:27 user nova-compute[80928]: node.session.auth.password = ***
Nov 16 05:42:27 user nova-compute[80928]: node.session.auth.username_in = <empty>
Nov 16 05:42:27 user nova-compute[80928]: node.session.auth.password_in = <empty>
Nov 16 05:42:27 user nova-compute[80928]: node.session.auth.chap_algs = MD5
Nov 16 05:42:27 user nova-compute[80928]: node.session.timeo.replacement_timeout = 120
Nov 16 05:42:27 user nova-compute[80928]: node.session.err_timeo.abort_timeout = 15
Nov 16 05:42:27 user nova-compute[80928]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 05:42:27 user nova-compute[80928]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 05:42:27 user nova-compute[80928]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 05:42:27 user nova-compute[80928]: node.session.iscsi.FastAbort = Yes
Nov 16 05:42:27 user nova-compute[80928]: node.session.iscsi.InitialR2T = No
Nov 16 05:42:27 user nova-compute[80928]: node.session.iscsi.ImmediateData = Yes
Nov 16 05:42:27 user nova-compute[80928]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 05:42:27 user nova-compute[80928]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 05:42:27 user nova-compute[80928]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 05:42:27 user nova-compute[80928]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 05:42:27 user nova-compute[80928]: node.session.iscsi.MaxConnections = 1
Nov 16 05:42:27 user nova-compute[80928]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 05:42:27 user nova-compute[80928]: node.session.iscsi.ERL = 0
Nov 16 05:42:27 user nova-compute[80928]: node.session.scan = manual
Nov 16 05:42:27 user nova-compute[80928]: node.session.reopen_max = 0
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].address = 172.16.0.220
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].port = 3260
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].startup = manual
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].tcp.window_size = 524288
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].tcp.type_of_service = 0
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].timeo.logout_timeout = 15
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].timeo.login_timeout = 15
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].timeo.auth_timeout = 45
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].iscsi.DataDigest = None
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].iscsi.IFMarker = No
Nov 16 05:42:27 user nova-compute[80928]: node.conn[0].iscsi.OFMarker = No
Nov 16 05:42:27 user nova-compute[80928]: # END RECORD
Nov 16 05:42:27 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8a3b97-6ec7-4f56-9b3c-1b185b641044]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a737f9-93c3-4c4d-8f98-c93b87ff70ab]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hDciazuo {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hDciazuo" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e3a918-ca83-47b6-9445-a983020d7de3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hDciazuo'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e4451d-825f-4ce1-b5f2-9b51499d472a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3761a0c-b081-4fa9-bccc-c0a4468bd42a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:42:27 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:42:27 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:42:27 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:42:27 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:42:27 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:42:27 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.136s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] HCTL ('37', '0', '0', 0) found on session 34 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70add66-8fc6-4290-97ba-3481c7bd3626]: (4, ('0 0 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Searching for a device in session 34 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDciazuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.159s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] <== connect_volume: return (160ms) {'type': 'block', 'scsi_wwn': '23565333536613337', 'path': '/dev/sdf'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:42:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565333536613337', 'path': '/dev/sdf'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1390268242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1390268242',id=31,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-en9b6r0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:40:51Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=0a2fc694-8d82-4f4b-971d-18454c975fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "vif_mac": "fa:16:3e:57:91:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "vif_mac": "fa:16:3e:57:91:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:91:f4,bridge_name='br-int',has_traffic_filtering=True,id=1db814a1-9a0c-47e2-9e29-5e7616a8156c,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db814a1-9a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a2fc694-8d82-4f4b-971d-18454c975fcd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG nova.objects.base [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Object Instance<0a2fc694-8d82-4f4b-971d-18454c975fcd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:42:28 user nova-compute[80928]:   <uuid>0a2fc694-8d82-4f4b-971d-18454c975fcd</uuid>
Nov 16 05:42:28 user nova-compute[80928]:   <name>instance-0000001f</name>
Nov 16 05:42:28 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:42:28 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:42:28 user nova-compute[80928]:   <metadata>
Nov 16 05:42:28 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:42:28 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:42:28 user nova-compute[80928]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1390268242</nova:name>
Nov 16 05:42:28 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:42:27</nova:creationTime>
Nov 16 05:42:28 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:42:28 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:42:28 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:42:28 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:42:28 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:42:28 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:42:28 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:42:28 user nova-compute[80928]:       <nova:owner>
Nov 16 05:42:28 user nova-compute[80928]:         <nova:user uuid="3bb9af29de44488282666171f2bcad47">tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member</nova:user>
Nov 16 05:42:28 user nova-compute[80928]:         <nova:project uuid="995121e71e234f60b7f7d5ac0abcc0f1">tempest-ServerBootFromVolumeStableRescueTest-1026359285</nova:project>
Nov 16 05:42:28 user nova-compute[80928]:       </nova:owner>
Nov 16 05:42:28 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:42:28 user nova-compute[80928]:       <nova:ports>
Nov 16 05:42:28 user nova-compute[80928]:         <nova:port uuid="1db814a1-9a0c-47e2-9e29-5e7616a8156c">
Nov 16 05:42:28 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 05:42:28 user nova-compute[80928]:         </nova:port>
Nov 16 05:42:28 user nova-compute[80928]:       </nova:ports>
Nov 16 05:42:28 user nova-compute[80928]:     </nova:instance>
Nov 16 05:42:28 user nova-compute[80928]:   </metadata>
Nov 16 05:42:28 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:42:28 user nova-compute[80928]:     <system>
Nov 16 05:42:28 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:42:28 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:42:28 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:42:28 user nova-compute[80928]:       <entry name="serial">0a2fc694-8d82-4f4b-971d-18454c975fcd</entry>
Nov 16 05:42:28 user nova-compute[80928]:       <entry name="uuid">0a2fc694-8d82-4f4b-971d-18454c975fcd</entry>
Nov 16 05:42:28 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:42:28 user nova-compute[80928]:     </system>
Nov 16 05:42:28 user nova-compute[80928]:   </sysinfo>
Nov 16 05:42:28 user nova-compute[80928]:   <os>
Nov 16 05:42:28 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:42:28 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:42:28 user nova-compute[80928]:   </os>
Nov 16 05:42:28 user nova-compute[80928]:   <features>
Nov 16 05:42:28 user nova-compute[80928]:     <acpi/>
Nov 16 05:42:28 user nova-compute[80928]:     <apic/>
Nov 16 05:42:28 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:42:28 user nova-compute[80928]:   </features>
Nov 16 05:42:28 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:42:28 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:42:28 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:42:28 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:42:28 user nova-compute[80928]:   </clock>
Nov 16 05:42:28 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:42:28 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:42:28 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:42:28 user nova-compute[80928]:   </cpu>
Nov 16 05:42:28 user nova-compute[80928]:   <devices>
Nov 16 05:42:28 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:42:28 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:42:28 user nova-compute[80928]:       <source dev="/dev/sdf"/>
Nov 16 05:42:28 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:42:28 user nova-compute[80928]:       <serial>18b5e9d1-d53f-4270-9e0f-af1302953f1d</serial>
Nov 16 05:42:28 user nova-compute[80928]:     </disk>
Nov 16 05:42:28 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:42:28 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:42:28 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.rescue"/>
Nov 16 05:42:28 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:42:28 user nova-compute[80928]:       <boot order="1"/>
Nov 16 05:42:28 user nova-compute[80928]:     </disk>
Nov 16 05:42:28 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:42:28 user nova-compute[80928]:       <mac address="fa:16:3e:57:91:f4"/>
Nov 16 05:42:28 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:42:28 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:42:28 user nova-compute[80928]:       <target dev="tap1db814a1-9a"/>
Nov 16 05:42:28 user nova-compute[80928]:     </interface>
Nov 16 05:42:28 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:42:28 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/console.log" append="off"/>
Nov 16 05:42:28 user nova-compute[80928]:     </serial>
Nov 16 05:42:28 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:42:28 user nova-compute[80928]:     <video>
Nov 16 05:42:28 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:42:28 user nova-compute[80928]:     </video>
Nov 16 05:42:28 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:42:28 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:42:28 user nova-compute[80928]:     </rng>
Nov 16 05:42:28 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:42:28 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:42:28 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:42:28 user nova-compute[80928]:     </memballoon>
Nov 16 05:42:28 user nova-compute[80928]:   </devices>
Nov 16 05:42:28 user nova-compute[80928]: </domain>
Nov 16 05:42:28 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:42:28 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Instance destroyed successfully.
Nov 16 05:42:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] No VIF found with MAC fa:16:3e:57:91:f4, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Port a88de70f-c14d-47d8-8b55-fd423eece4d6 binding to destination host user is already ACTIVE {{(pid=80928) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquired lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updating instance_info_cache with network_info: [{"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:42:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Releasing lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG os_brick.utils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a38b34a-8d0f-4cef-9fd3-1a0cc8afa389]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[989383c0-2221-49fd-9e77-07820bd3a718]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6280a291-65e5-4fd3-8105-ca86f3d9329e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f317884-a255-4df9-b173-e6faaaa7b8f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:42:29 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc121c5-362e-4225-9d6a-bc539e180353]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG os_brick.utils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-6d7f5b22-8fb5-423f-b9f0-84a8e98cdc9f req-60810f28-4a35-41a0-820f-d3c5a0de6a3a service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6d7f5b22-8fb5-423f-b9f0-84a8e98cdc9f req-60810f28-4a35-41a0-820f-d3c5a0de6a3a service nova] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6d7f5b22-8fb5-423f-b9f0-84a8e98cdc9f req-60810f28-4a35-41a0-820f-d3c5a0de6a3a service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6d7f5b22-8fb5-423f-b9f0-84a8e98cdc9f req-60810f28-4a35-41a0-820f-d3c5a0de6a3a service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-6d7f5b22-8fb5-423f-b9f0-84a8e98cdc9f req-60810f28-4a35-41a0-820f-d3c5a0de6a3a service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] No waiting events found dispatching network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:29 user nova-compute[80928]: WARNING nova.compute.manager [req-6d7f5b22-8fb5-423f-b9f0-84a8e98cdc9f req-60810f28-4a35-41a0-820f-d3c5a0de6a3a service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received unexpected event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c for instance with vm_state active and task_state rescuing.
Nov 16 05:42:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:31 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7d4e153e-c7df-4d0e-86b1-bb583ed7cfe7 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:42:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-0971815e-0e34-407f-8a9a-106946c783ef req-445077f7-bd37-47ae-8760-ce476331c01b service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0971815e-0e34-407f-8a9a-106946c783ef req-445077f7-bd37-47ae-8760-ce476331c01b service nova] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0971815e-0e34-407f-8a9a-106946c783ef req-445077f7-bd37-47ae-8760-ce476331c01b service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0971815e-0e34-407f-8a9a-106946c783ef req-445077f7-bd37-47ae-8760-ce476331c01b service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-0971815e-0e34-407f-8a9a-106946c783ef req-445077f7-bd37-47ae-8760-ce476331c01b service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] No waiting events found dispatching network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:31 user nova-compute[80928]: WARNING nova.compute.manager [req-0971815e-0e34-407f-8a9a-106946c783ef req-445077f7-bd37-47ae-8760-ce476331c01b service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received unexpected event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c for instance with vm_state active and task_state rescuing.
Nov 16 05:42:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "c5ae2c42-de68-4619-96a1-643755597b99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:31 user nova-compute[80928]: INFO nova.compute.manager [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Detaching volume ecbd670a-5d3b-4a78-9552-3fb8281a572b
Nov 16 05:42:32 user nova-compute[80928]: INFO nova.virt.block_device [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Attempting to driver detach volume ecbd670a-5d3b-4a78-9552-3fb8281a572b from mountpoint /dev/vdb
Nov 16 05:42:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Attempting to detach device vdb from instance c5ae2c42-de68-4619-96a1-643755597b99 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:42:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:42:32 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:42:32 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:42:32 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:42:32 user nova-compute[80928]:   <serial>ecbd670a-5d3b-4a78-9552-3fb8281a572b</serial>
Nov 16 05:42:32 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:42:32 user nova-compute[80928]: </disk>
Nov 16 05:42:32 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:42:32 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Successfully detached device vdb from instance c5ae2c42-de68-4619-96a1-643755597b99 from the persistent domain config.
Nov 16 05:42:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c5ae2c42-de68-4619-96a1-643755597b99 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:42:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:42:32 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:42:32 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:42:32 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:42:32 user nova-compute[80928]:   <serial>ecbd670a-5d3b-4a78-9552-3fb8281a572b</serial>
Nov 16 05:42:32 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:42:32 user nova-compute[80928]: </disk>
Nov 16 05:42:32 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:42:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Starting finish_migration {{(pid=80928) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Instance directory exists: not creating {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 05:42:34 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Creating image(s)
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Ensure instance console log exists: /opt/stack/data/nova/instances/765e9a3f-b188-483c-b149-2df53766fed8/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Start _get_guest_xml network_info=[{"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-486420499-network", "vif_mac": "fa:16:3e:2c:8f:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVwTftrU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '765e9a3f-b188-483c-b149-2df53766fed8', 'attached_at': '2023-11-16T05:42:34.000000', 'detached_at': '', 'volume_id': '0a539086-0cc0-44fc-8cdf-7f4d8e85377d', 'serial': '0a539086-0cc0-44fc-8cdf-7f4d8e85377d'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'df94f873-52bd-4c50-b854-83a99f5b9ce7', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:42:34 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:42:34 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVwTftrU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:42:34 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:42:34 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:42:34 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b678fd42-9c00-4e1a-816c-259a40cf1803]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:42:34 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8b04be-6174-4b0b-957c-863b3714a1b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d] added
Nov 16 05:42:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d6de2e-26b6-45e4-83ba-a3a5906bd400]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6813f9d-6b3e-4c1f-8ed9-5f43af5168c4]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MVwTftrU {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MVwTftrU" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2518b3-f6f5-48fd-9d14-699dcdf2b716]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MVwTftrU'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8dd09c-8521-4d87-a35a-76de20c617ce]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9257956-e0b5-4e58-9552-8b38da569725]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:42:34 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:42:34 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:42:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:42:34 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:42:34 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:42:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eaa588-81b3-4a20-8715-1034662a1dbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260]
Nov 16 05:42:34 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260] successful.
Nov 16 05:42:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[198030ec-2077-4d12-8ebf-dbc4c560c0d3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4cdd30-5bd9-4068-8a08-887d2b1371a2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:42:34 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:42:34 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:42:34 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:42:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:42:34 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:42:34 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:42:34 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:42:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc65788-0315-456e-95ec-4964dd6a6aeb]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:34 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:42:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:42:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVwTftrU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:42:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:42:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23937616539363864', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:42:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937616539363864', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-171787261',display_name='tempest-ServerActionsTestOtherA-server-171787261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-171787261',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIRZfEcvuwNYhj/y1xM6mcxohhx0m8ZHaUgJiSsxMQwSOGLIDwHJFsK0QD5y79ZqmyvT9tlBnMJypgzLM6OAyjdPrnmqxNSLqGp1Mi6dH0+QoZTXMm8gRWHjmecV7kNjw==',key_name='tempest-keypair-1523932878',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:40:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-he6qqyb2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=765e9a3f-b188-483c-b149-2df53766fed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-486420499-network", "vif_mac": "fa:16:3e:2c:8f:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-486420499-network", "vif_mac": "fa:16:3e:2c:8f:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:42:36 user nova-compute[80928]:   <uuid>765e9a3f-b188-483c-b149-2df53766fed8</uuid>
Nov 16 05:42:36 user nova-compute[80928]:   <name>instance-0000001e</name>
Nov 16 05:42:36 user nova-compute[80928]:   <memory>2097152</memory>
Nov 16 05:42:36 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:42:36 user nova-compute[80928]:   <metadata>
Nov 16 05:42:36 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:42:36 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:42:36 user nova-compute[80928]:       <nova:name>tempest-ServerActionsTestOtherA-server-171787261</nova:name>
Nov 16 05:42:36 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:42:34</nova:creationTime>
Nov 16 05:42:36 user nova-compute[80928]:       <nova:flavor name="m1.small">
Nov 16 05:42:36 user nova-compute[80928]:         <nova:memory>2048</nova:memory>
Nov 16 05:42:36 user nova-compute[80928]:         <nova:disk>20</nova:disk>
Nov 16 05:42:36 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:42:36 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:42:36 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:42:36 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:42:36 user nova-compute[80928]:       <nova:owner>
Nov 16 05:42:36 user nova-compute[80928]:         <nova:user uuid="6b1697de2fd04b27bc89ec6430a8a51d">tempest-ServerActionsTestOtherA-1550926993-project-member</nova:user>
Nov 16 05:42:36 user nova-compute[80928]:         <nova:project uuid="9684eff8dae04ceeb858555284d27e39">tempest-ServerActionsTestOtherA-1550926993</nova:project>
Nov 16 05:42:36 user nova-compute[80928]:       </nova:owner>
Nov 16 05:42:36 user nova-compute[80928]:       <nova:ports>
Nov 16 05:42:36 user nova-compute[80928]:         <nova:port uuid="a88de70f-c14d-47d8-8b55-fd423eece4d6">
Nov 16 05:42:36 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:42:36 user nova-compute[80928]:         </nova:port>
Nov 16 05:42:36 user nova-compute[80928]:       </nova:ports>
Nov 16 05:42:36 user nova-compute[80928]:     </nova:instance>
Nov 16 05:42:36 user nova-compute[80928]:   </metadata>
Nov 16 05:42:36 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:42:36 user nova-compute[80928]:     <system>
Nov 16 05:42:36 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:42:36 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:42:36 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:42:36 user nova-compute[80928]:       <entry name="serial">765e9a3f-b188-483c-b149-2df53766fed8</entry>
Nov 16 05:42:36 user nova-compute[80928]:       <entry name="uuid">765e9a3f-b188-483c-b149-2df53766fed8</entry>
Nov 16 05:42:36 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:42:36 user nova-compute[80928]:     </system>
Nov 16 05:42:36 user nova-compute[80928]:   </sysinfo>
Nov 16 05:42:36 user nova-compute[80928]:   <os>
Nov 16 05:42:36 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:42:36 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:42:36 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:42:36 user nova-compute[80928]:   </os>
Nov 16 05:42:36 user nova-compute[80928]:   <features>
Nov 16 05:42:36 user nova-compute[80928]:     <acpi/>
Nov 16 05:42:36 user nova-compute[80928]:     <apic/>
Nov 16 05:42:36 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:42:36 user nova-compute[80928]:   </features>
Nov 16 05:42:36 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:42:36 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:42:36 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:42:36 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:42:36 user nova-compute[80928]:   </clock>
Nov 16 05:42:36 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:42:36 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:42:36 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:42:36 user nova-compute[80928]:   </cpu>
Nov 16 05:42:36 user nova-compute[80928]:   <devices>
Nov 16 05:42:36 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:42:36 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:42:36 user nova-compute[80928]:       <source dev="/dev/sdc"/>
Nov 16 05:42:36 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:42:36 user nova-compute[80928]:       <serial>0a539086-0cc0-44fc-8cdf-7f4d8e85377d</serial>
Nov 16 05:42:36 user nova-compute[80928]:     </disk>
Nov 16 05:42:36 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:42:36 user nova-compute[80928]:       <mac address="fa:16:3e:2c:8f:a2"/>
Nov 16 05:42:36 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:42:36 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:42:36 user nova-compute[80928]:       <target dev="tapa88de70f-c1"/>
Nov 16 05:42:36 user nova-compute[80928]:     </interface>
Nov 16 05:42:36 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:42:36 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/765e9a3f-b188-483c-b149-2df53766fed8/console.log" append="off"/>
Nov 16 05:42:36 user nova-compute[80928]:     </serial>
Nov 16 05:42:36 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:42:36 user nova-compute[80928]:     <video>
Nov 16 05:42:36 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:42:36 user nova-compute[80928]:     </video>
Nov 16 05:42:36 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:42:36 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:42:36 user nova-compute[80928]:     </rng>
Nov 16 05:42:36 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:42:36 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:42:36 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:42:36 user nova-compute[80928]:     </memballoon>
Nov 16 05:42:36 user nova-compute[80928]:   </devices>
Nov 16 05:42:36 user nova-compute[80928]: </domain>
Nov 16 05:42:36 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-171787261',display_name='tempest-ServerActionsTestOtherA-server-171787261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-171787261',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIRZfEcvuwNYhj/y1xM6mcxohhx0m8ZHaUgJiSsxMQwSOGLIDwHJFsK0QD5y79ZqmyvT9tlBnMJypgzLM6OAyjdPrnmqxNSLqGp1Mi6dH0+QoZTXMm8gRWHjmecV7kNjw==',key_name='tempest-keypair-1523932878',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:40:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-he6qqyb2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=765e9a3f-b188-483c-b149-2df53766fed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-486420499-network", "vif_mac": "fa:16:3e:2c:8f:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-486420499-network", "vif_mac": "fa:16:3e:2c:8f:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG os_vif [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5dead64-41c0-5c12-86e6-dd5ac45d860f', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa88de70f-c1, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa88de70f-c1, col_values=(('qos', UUID('90313daf-ad6b-422d-b14e-e2e7452f7572')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa88de70f-c1, col_values=(('external_ids', {'iface-id': 'a88de70f-c14d-47d8-8b55-fd423eece4d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:8f:a2', 'vm-uuid': '765e9a3f-b188-483c-b149-2df53766fed8'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:36 user nova-compute[80928]: INFO os_vif [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1')
Nov 16 05:42:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:42:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] No VIF found with MAC fa:16:3e:2c:8f:a2, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:42:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:37 user nova-compute[80928]: DEBUG nova.compute.manager [req-f1a94e81-49ee-46d4-927e-3dfda056ee1f req-3c8299fd-bc37-4274-9c25-fab2dfa553d7 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f1a94e81-49ee-46d4-927e-3dfda056ee1f req-3c8299fd-bc37-4274-9c25-fab2dfa553d7 service nova] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f1a94e81-49ee-46d4-927e-3dfda056ee1f req-3c8299fd-bc37-4274-9c25-fab2dfa553d7 service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f1a94e81-49ee-46d4-927e-3dfda056ee1f req-3c8299fd-bc37-4274-9c25-fab2dfa553d7 service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:37 user nova-compute[80928]: DEBUG nova.compute.manager [req-f1a94e81-49ee-46d4-927e-3dfda056ee1f req-3c8299fd-bc37-4274-9c25-fab2dfa553d7 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] No waiting events found dispatching network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:37 user nova-compute[80928]: WARNING nova.compute.manager [req-f1a94e81-49ee-46d4-927e-3dfda056ee1f req-3c8299fd-bc37-4274-9c25-fab2dfa553d7 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received unexpected event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 for instance with vm_state active and task_state resize_finish.
Nov 16 05:42:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:39 user nova-compute[80928]: DEBUG nova.compute.manager [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:42:39 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Instance running successfully.
Nov 16 05:42:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Failed to set time: agent not configured {{(pid=80928) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 05:42:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6b63a5dd-7d56-4579-8972-efcc0c54d0c9 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] finish_migration finished successfully. {{(pid=80928) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 05:42:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-143b4100-b6c0-4526-b852-ab41a52ff214 req-2d55576e-372e-489d-8798-d73b60a0d76b service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:42:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-143b4100-b6c0-4526-b852-ab41a52ff214 req-2d55576e-372e-489d-8798-d73b60a0d76b service nova] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:42:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-143b4100-b6c0-4526-b852-ab41a52ff214 req-2d55576e-372e-489d-8798-d73b60a0d76b service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:42:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-143b4100-b6c0-4526-b852-ab41a52ff214 req-2d55576e-372e-489d-8798-d73b60a0d76b service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-143b4100-b6c0-4526-b852-ab41a52ff214 req-2d55576e-372e-489d-8798-d73b60a0d76b service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] No waiting events found dispatching network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:42:39 user nova-compute[80928]: WARNING nova.compute.manager [req-143b4100-b6c0-4526-b852-ab41a52ff214 req-2d55576e-372e-489d-8798-d73b60a0d76b service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received unexpected event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 for instance with vm_state active and task_state resize_finish.
Nov 16 05:42:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:52 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c5ae2c42-de68-4619-96a1-643755597b99 is timed out.
Nov 16 05:42:52 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Successfully detached device vdb from instance c5ae2c42-de68-4619-96a1-643755597b99 from the live domain config.
Nov 16 05:42:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJqPXwEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:42:52 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b390c8fb-5370-4fd5-a111-b12fb5b80c69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:42:52 user nova-compute[80928]: No targets found.
Nov 16 05:42:52 user nova-compute[80928]: iSNS:
Nov 16 05:42:52 user nova-compute[80928]: No targets found.
Nov 16 05:42:52 user nova-compute[80928]: STATIC:
Nov 16 05:42:52 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d
Nov 16 05:42:52 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:42:52 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:42:52 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b
Nov 16 05:42:52 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:42:52 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:42:52 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:42:52 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:42:52 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:42:52 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d
Nov 16 05:42:52 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:42:52 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:42:52 user nova-compute[80928]: FIRMWARE:
Nov 16 05:42:52 user nova-compute[80928]: No targets found.
Nov 16 05:42:52 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:42:52 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:42:52 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[252b08d0-95b1-4af3-b8dd-b1a7a689bd1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa809fe1-dc52-4efa-8ac5-e07a7cf350f2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:42:52 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:42:52 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:42:52 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:42:52 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:42:52 user nova-compute[80928]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b (non-flash)
Nov 16 05:42:52 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:42:52 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:42:52 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86785dbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b'): ({'sdd'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Removing single pathed devices sdd {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e4f50b-68d2-4d2f-a4c3-25a91a024384]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6866e30-0808-494d-a28b-35e3da349b47]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Flushing IO for device /dev/sdd {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[28612c20-c64d-481d-8b56-9dd7d4e1699c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2332c0d6-36f0-4821-8d23-e4faf1563f99]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af18cdd-c0e7-4a5a-bce7-28bae267d664]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0dde93-32d0-4382-8eb3-d0a0265bf7b2]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b, portal: 172.16.0.220,3260]
Nov 16 05:42:52 user nova-compute[80928]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b, portal: 172.16.0.220,3260] successful.
Nov 16 05:42:52 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:42:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecbd670a-5d3b-4a78-9552-3fb8281a572b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:42:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[62efa0ae-f7c9-4bd3-85af-d91b9ada2598]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:42:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:42:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:42:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] <== disconnect_volume: return (369ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:42:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:42:53 user nova-compute[80928]: DEBUG nova.objects.instance [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lazy-loading 'flavor' on Instance uuid c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:42:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e4d677d-7561-4419-b158-10759bd3a790 tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "c5ae2c42-de68-4619-96a1-643755597b99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.850s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:42:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:42:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:43:00 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:43:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:43:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:43:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:43:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:43:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:43:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:43:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:43:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:43:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updating instance_info_cache with network_info: [{"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-762caa99-5c4a-428d-8059-7903d0bdb149" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:43:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:43:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:11 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:43:11 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7759MB free_disk=25.087581634521484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Applying migration context for instance 765e9a3f-b188-483c-b149-2df53766fed8 as it has an incoming, in-progress migration 08f41834-fa95-4095-babf-4b53e74b9cf4. Migration status is finished {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 05:43:11 user nova-compute[80928]: INFO nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updating resource usage from migration 08f41834-fa95-4095-babf-4b53e74b9cf4
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance c5ae2c42-de68-4619-96a1-643755597b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 310c7fc9-af32-42dd-be30-8460daa03279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 0a2fc694-8d82-4f4b-971d-18454c975fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Migration 08f41834-fa95-4095-babf-4b53e74b9cf4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 765e9a3f-b188-483c-b149-2df53766fed8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:43:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:12 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:43:12 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:43:12 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:43:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "c5ae2c42-de68-4619-96a1-643755597b99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:22 user nova-compute[80928]: INFO nova.compute.manager [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Terminating instance
Nov 16 05:43:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:43:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-e7d1c7ad-990b-4f42-a21c-e376dac2c347 req-d5f58ff8-d5de-497e-bb5d-a9e43c37354f service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-unplugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:43:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e7d1c7ad-990b-4f42-a21c-e376dac2c347 req-d5f58ff8-d5de-497e-bb5d-a9e43c37354f service nova] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e7d1c7ad-990b-4f42-a21c-e376dac2c347 req-d5f58ff8-d5de-497e-bb5d-a9e43c37354f service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e7d1c7ad-990b-4f42-a21c-e376dac2c347 req-d5f58ff8-d5de-497e-bb5d-a9e43c37354f service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-e7d1c7ad-990b-4f42-a21c-e376dac2c347 req-d5f58ff8-d5de-497e-bb5d-a9e43c37354f service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] No waiting events found dispatching network-vif-unplugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-e7d1c7ad-990b-4f42-a21c-e376dac2c347 req-d5f58ff8-d5de-497e-bb5d-a9e43c37354f service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-unplugged-c5104be0-b766-4a44-807e-b82c40dadbd7 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:43:23 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Instance destroyed successfully.
Nov 16 05:43:23 user nova-compute[80928]: DEBUG nova.objects.instance [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lazy-loading 'resources' on Instance uuid c5ae2c42-de68-4619-96a1-643755597b99 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:36:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1482561676',display_name='tempest-ServerStableDeviceRescueTest-server-1482561676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1482561676',id=23,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKM6OfVy/fMoIkNAdBQlGs4YsuhKbjo7U4Pyhuu7nQuz9iHjfG0KiqaWAje4kVGSOOuefUjVyscdxC0DNYuZ5nMnKV1B3Xmel+CsWGIxTUzunTopS8qV71E3xKU2h9HMA==',key_name='tempest-keypair-476297108',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:40:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6f752bfba814502898ca7f73eff7e0d',ramdisk_id='',reservation_id='r-8q6twa87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-805900344',owner_user_name='tempest-ServerStableDeviceRescueTest-805900344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:42:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f937540a5dd54473ad0858f2776ddf66',uuid=c5ae2c42-de68-4619-96a1-643755597b99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Converting VIF {"id": "c5104be0-b766-4a44-807e-b82c40dadbd7", "address": "fa:16:3e:5e:42:ac", "network": {"id": "04fdc294-b4a4-4900-9dae-f650571e0829", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824135828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6f752bfba814502898ca7f73eff7e0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5104be0-b7", "ovs_interfaceid": "c5104be0-b766-4a44-807e-b82c40dadbd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5104be0-b766-4a44-807e-b82c40dadbd7,network=Network(04fdc294-b4a4-4900-9dae-f650571e0829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5104be0-b7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG os_vif [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5104be0-b766-4a44-807e-b82c40dadbd7,network=Network(04fdc294-b4a4-4900-9dae-f650571e0829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5104be0-b7') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5104be0-b7, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7411c3c-5ce7-4f93-b8af-039180c8502d) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:23 user nova-compute[80928]: INFO os_vif [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5104be0-b766-4a44-807e-b82c40dadbd7,network=Network(04fdc294-b4a4-4900-9dae-f650571e0829),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5104be0-b7')
Nov 16 05:43:23 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Deleting instance files /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99_del
Nov 16 05:43:23 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Deletion of /opt/stack/data/nova/instances/c5ae2c42-de68-4619-96a1-643755597b99_del complete
Nov 16 05:43:23 user nova-compute[80928]: INFO nova.compute.manager [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 05:43:23 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:43:23 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: c5ae2c42-de68-4619-96a1-643755597b99] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:43:24 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:43:24 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Took 0.94 seconds to deallocate network for instance.
Nov 16 05:43:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-a0a5ad99-4a44-4d3c-a7bd-aaa1cebf54da req-735bc2c5-9281-4322-a629-c5d8fe3144d0 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-deleted-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:43:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:24 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:43:24 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:43:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:24 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Deleted allocations for instance c5ae2c42-de68-4619-96a1-643755597b99
Nov 16 05:43:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-610d66b0-f817-4ac2-869f-19e62aea47ab tempest-ServerStableDeviceRescueTest-805900344 tempest-ServerStableDeviceRescueTest-805900344-project-member] Lock "c5ae2c42-de68-4619-96a1-643755597b99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.332s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-de3a3c79-bfa5-478e-abb4-d5b6fdea9395 req-fc1fa43e-1117-4ff8-9c9d-f25dabc2ce47 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:43:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de3a3c79-bfa5-478e-abb4-d5b6fdea9395 req-fc1fa43e-1117-4ff8-9c9d-f25dabc2ce47 service nova] Acquiring lock "c5ae2c42-de68-4619-96a1-643755597b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de3a3c79-bfa5-478e-abb4-d5b6fdea9395 req-fc1fa43e-1117-4ff8-9c9d-f25dabc2ce47 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-de3a3c79-bfa5-478e-abb4-d5b6fdea9395 req-fc1fa43e-1117-4ff8-9c9d-f25dabc2ce47 service nova] Lock "c5ae2c42-de68-4619-96a1-643755597b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-de3a3c79-bfa5-478e-abb4-d5b6fdea9395 req-fc1fa43e-1117-4ff8-9c9d-f25dabc2ce47 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] No waiting events found dispatching network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:43:25 user nova-compute[80928]: WARNING nova.compute.manager [req-de3a3c79-bfa5-478e-abb4-d5b6fdea9395 req-fc1fa43e-1117-4ff8-9c9d-f25dabc2ce47 service nova] [instance: c5ae2c42-de68-4619-96a1-643755597b99] Received unexpected event network-vif-plugged-c5104be0-b766-4a44-807e-b82c40dadbd7 for instance with vm_state deleted and task_state None.
Nov 16 05:43:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:43:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:43:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:43:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:43:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:43:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:43:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:55 user nova-compute[80928]: INFO nova.compute.manager [None req-d34b47ee-89ed-4ad6-b207-0e3aaff2bf4e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Unrescuing
Nov 16 05:43:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d34b47ee-89ed-4ad6-b207-0e3aaff2bf4e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d34b47ee-89ed-4ad6-b207-0e3aaff2bf4e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquired lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d34b47ee-89ed-4ad6-b207-0e3aaff2bf4e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d34b47ee-89ed-4ad6-b207-0e3aaff2bf4e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Updating instance_info_cache with network_info: [{"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d34b47ee-89ed-4ad6-b207-0e3aaff2bf4e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Releasing lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-d34b47ee-89ed-4ad6-b207-0e3aaff2bf4e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'flavor' on Instance uuid 4a171080-2c54-4092-902d-7a3f815656b9 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-b916ce64-6d05-4211-b1c8-7f59c551081f req-5e7b3fcc-2c3d-4d61-98c9-f581b0bc9fb7 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-unplugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b916ce64-6d05-4211-b1c8-7f59c551081f req-5e7b3fcc-2c3d-4d61-98c9-f581b0bc9fb7 service nova] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b916ce64-6d05-4211-b1c8-7f59c551081f req-5e7b3fcc-2c3d-4d61-98c9-f581b0bc9fb7 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b916ce64-6d05-4211-b1c8-7f59c551081f req-5e7b3fcc-2c3d-4d61-98c9-f581b0bc9fb7 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-b916ce64-6d05-4211-b1c8-7f59c551081f req-5e7b3fcc-2c3d-4d61-98c9-f581b0bc9fb7 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] No waiting events found dispatching network-vif-unplugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:43:55 user nova-compute[80928]: WARNING nova.compute.manager [req-b916ce64-6d05-4211-b1c8-7f59c551081f req-5e7b3fcc-2c3d-4d61-98c9-f581b0bc9fb7 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received unexpected event network-vif-unplugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:43:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Instance destroyed successfully.
Nov 16 05:43:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:43:57 user nova-compute[80928]: INFO nova.compute.claims [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Claim successful on node user
Nov 16 05:43:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-948bbe4a-7811-4d8f-9897-f769d125f320 req-2a1c1719-a8eb-4d0b-9683-62199677cf4a service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-948bbe4a-7811-4d8f-9897-f769d125f320 req-2a1c1719-a8eb-4d0b-9683-62199677cf4a service nova] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-948bbe4a-7811-4d8f-9897-f769d125f320 req-2a1c1719-a8eb-4d0b-9683-62199677cf4a service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-948bbe4a-7811-4d8f-9897-f769d125f320 req-2a1c1719-a8eb-4d0b-9683-62199677cf4a service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-948bbe4a-7811-4d8f-9897-f769d125f320 req-2a1c1719-a8eb-4d0b-9683-62199677cf4a service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] No waiting events found dispatching network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:43:57 user nova-compute[80928]: WARNING nova.compute.manager [req-948bbe4a-7811-4d8f-9897-f769d125f320 req-2a1c1719-a8eb-4d0b-9683-62199677cf4a service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received unexpected event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:43:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-948bbe4a-7811-4d8f-9897-f769d125f320 req-2a1c1719-a8eb-4d0b-9683-62199677cf4a service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-948bbe4a-7811-4d8f-9897-f769d125f320 req-2a1c1719-a8eb-4d0b-9683-62199677cf4a service nova] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-948bbe4a-7811-4d8f-9897-f769d125f320 req-2a1c1719-a8eb-4d0b-9683-62199677cf4a service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-948bbe4a-7811-4d8f-9897-f769d125f320 req-2a1c1719-a8eb-4d0b-9683-62199677cf4a service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-948bbe4a-7811-4d8f-9897-f769d125f320 req-2a1c1719-a8eb-4d0b-9683-62199677cf4a service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] No waiting events found dispatching network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:43:57 user nova-compute[80928]: WARNING nova.compute.manager [req-948bbe4a-7811-4d8f-9897-f769d125f320 req-2a1c1719-a8eb-4d0b-9683-62199677cf4a service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received unexpected event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:43:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:43:58 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:43:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG nova.policy [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aa0aac565144c2d93bc4c649f60c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c114702dc14f2d8462f313ea4999af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:43:58 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Creating image(s)
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "/opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "/opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "/opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk 1073741824" returned: 0 in 0.062s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.200s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Successfully created port: 4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:43:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Cannot resize image /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Ensure instance console log exists: /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Successfully updated port: 4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "refresh_cache-22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquired lock "refresh_cache-22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Updating instance_info_cache with network_info: [{"id": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "address": "fa:16:3e:fa:d8:93", "network": {"id": "7de5f7dc-2d57-44b1-abd9-e135d7a3428b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-448110210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64c114702dc14f2d8462f313ea4999af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f77cc7a-2a", "ovs_interfaceid": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Releasing lock "refresh_cache-22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Instance network_info: |[{"id": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "address": "fa:16:3e:fa:d8:93", "network": {"id": "7de5f7dc-2d57-44b1-abd9-e135d7a3428b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-448110210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64c114702dc14f2d8462f313ea4999af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f77cc7a-2a", "ovs_interfaceid": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Start _get_guest_xml network_info=[{"id": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "address": "fa:16:3e:fa:d8:93", "network": {"id": "7de5f7dc-2d57-44b1-abd9-e135d7a3428b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-448110210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64c114702dc14f2d8462f313ea4999af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f77cc7a-2a", "ovs_interfaceid": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:43:59 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:43:59 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1587916826',display_name='tempest-SnapshotDataIntegrityTests-server-1587916826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1587916826',id=32,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+Sfp8Nb061ty6rWe7039S/9YIQDNJl9bazLsrqbPtdtENrQpeywOn9Y1jQult7XVrFNs7fzn+94TXLm16ulBrnJgtJ6lGtylNGnZ6uM2L1rxTtHoEh5jplEAtQupJsfg==',key_name='tempest-keypair-482834326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64c114702dc14f2d8462f313ea4999af',ramdisk_id='',reservation_id='r-yhvwli7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1321900073',owner_user_name='tempest-SnapshotDataIntegrityTests-1321900073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:43:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aa0aac565144c2d93bc4c649f60c462',uuid=22d30cdf-c6b3-4cf1-8caa-80223f9fe3af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "address": "fa:16:3e:fa:d8:93", "network": {"id": "7de5f7dc-2d57-44b1-abd9-e135d7a3428b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-448110210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64c114702dc14f2d8462f313ea4999af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f77cc7a-2a", "ovs_interfaceid": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Converting VIF {"id": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "address": "fa:16:3e:fa:d8:93", "network": {"id": "7de5f7dc-2d57-44b1-abd9-e135d7a3428b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-448110210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64c114702dc14f2d8462f313ea4999af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f77cc7a-2a", "ovs_interfaceid": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d8:93,bridge_name='br-int',has_traffic_filtering=True,id=4f77cc7a-2a19-4f3c-bbd4-d74d36912c91,network=Network(7de5f7dc-2d57-44b1-abd9-e135d7a3428b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f77cc7a-2a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.objects.instance [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'pci_devices' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:43:59 user nova-compute[80928]:   <uuid>22d30cdf-c6b3-4cf1-8caa-80223f9fe3af</uuid>
Nov 16 05:43:59 user nova-compute[80928]:   <name>instance-00000020</name>
Nov 16 05:43:59 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:43:59 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:43:59 user nova-compute[80928]:   <metadata>
Nov 16 05:43:59 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:43:59 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:43:59 user nova-compute[80928]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1587916826</nova:name>
Nov 16 05:43:59 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:43:59</nova:creationTime>
Nov 16 05:43:59 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:43:59 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:43:59 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:43:59 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:43:59 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:43:59 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:43:59 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:43:59 user nova-compute[80928]:       <nova:owner>
Nov 16 05:43:59 user nova-compute[80928]:         <nova:user uuid="8aa0aac565144c2d93bc4c649f60c462">tempest-SnapshotDataIntegrityTests-1321900073-project-member</nova:user>
Nov 16 05:43:59 user nova-compute[80928]:         <nova:project uuid="64c114702dc14f2d8462f313ea4999af">tempest-SnapshotDataIntegrityTests-1321900073</nova:project>
Nov 16 05:43:59 user nova-compute[80928]:       </nova:owner>
Nov 16 05:43:59 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:43:59 user nova-compute[80928]:       <nova:ports>
Nov 16 05:43:59 user nova-compute[80928]:         <nova:port uuid="4f77cc7a-2a19-4f3c-bbd4-d74d36912c91">
Nov 16 05:43:59 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 05:43:59 user nova-compute[80928]:         </nova:port>
Nov 16 05:43:59 user nova-compute[80928]:       </nova:ports>
Nov 16 05:43:59 user nova-compute[80928]:     </nova:instance>
Nov 16 05:43:59 user nova-compute[80928]:   </metadata>
Nov 16 05:43:59 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:43:59 user nova-compute[80928]:     <system>
Nov 16 05:43:59 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:43:59 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:43:59 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:43:59 user nova-compute[80928]:       <entry name="serial">22d30cdf-c6b3-4cf1-8caa-80223f9fe3af</entry>
Nov 16 05:43:59 user nova-compute[80928]:       <entry name="uuid">22d30cdf-c6b3-4cf1-8caa-80223f9fe3af</entry>
Nov 16 05:43:59 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:43:59 user nova-compute[80928]:     </system>
Nov 16 05:43:59 user nova-compute[80928]:   </sysinfo>
Nov 16 05:43:59 user nova-compute[80928]:   <os>
Nov 16 05:43:59 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:43:59 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:43:59 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:43:59 user nova-compute[80928]:   </os>
Nov 16 05:43:59 user nova-compute[80928]:   <features>
Nov 16 05:43:59 user nova-compute[80928]:     <acpi/>
Nov 16 05:43:59 user nova-compute[80928]:     <apic/>
Nov 16 05:43:59 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:43:59 user nova-compute[80928]:   </features>
Nov 16 05:43:59 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:43:59 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:43:59 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:43:59 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:43:59 user nova-compute[80928]:   </clock>
Nov 16 05:43:59 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:43:59 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:43:59 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:43:59 user nova-compute[80928]:   </cpu>
Nov 16 05:43:59 user nova-compute[80928]:   <devices>
Nov 16 05:43:59 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:43:59 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:43:59 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk"/>
Nov 16 05:43:59 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:43:59 user nova-compute[80928]:     </disk>
Nov 16 05:43:59 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:43:59 user nova-compute[80928]:       <mac address="fa:16:3e:fa:d8:93"/>
Nov 16 05:43:59 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:43:59 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:43:59 user nova-compute[80928]:       <target dev="tap4f77cc7a-2a"/>
Nov 16 05:43:59 user nova-compute[80928]:     </interface>
Nov 16 05:43:59 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:43:59 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/console.log" append="off"/>
Nov 16 05:43:59 user nova-compute[80928]:     </serial>
Nov 16 05:43:59 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:43:59 user nova-compute[80928]:     <video>
Nov 16 05:43:59 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:43:59 user nova-compute[80928]:     </video>
Nov 16 05:43:59 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:43:59 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:43:59 user nova-compute[80928]:     </rng>
Nov 16 05:43:59 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:43:59 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:43:59 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:43:59 user nova-compute[80928]:     </memballoon>
Nov 16 05:43:59 user nova-compute[80928]:   </devices>
Nov 16 05:43:59 user nova-compute[80928]: </domain>
Nov 16 05:43:59 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1587916826',display_name='tempest-SnapshotDataIntegrityTests-server-1587916826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1587916826',id=32,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+Sfp8Nb061ty6rWe7039S/9YIQDNJl9bazLsrqbPtdtENrQpeywOn9Y1jQult7XVrFNs7fzn+94TXLm16ulBrnJgtJ6lGtylNGnZ6uM2L1rxTtHoEh5jplEAtQupJsfg==',key_name='tempest-keypair-482834326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64c114702dc14f2d8462f313ea4999af',ramdisk_id='',reservation_id='r-yhvwli7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1321900073',owner_user_name='tempest-SnapshotDataIntegrityTests-1321900073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:43:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aa0aac565144c2d93bc4c649f60c462',uuid=22d30cdf-c6b3-4cf1-8caa-80223f9fe3af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "address": "fa:16:3e:fa:d8:93", "network": {"id": "7de5f7dc-2d57-44b1-abd9-e135d7a3428b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-448110210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64c114702dc14f2d8462f313ea4999af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f77cc7a-2a", "ovs_interfaceid": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Converting VIF {"id": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "address": "fa:16:3e:fa:d8:93", "network": {"id": "7de5f7dc-2d57-44b1-abd9-e135d7a3428b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-448110210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64c114702dc14f2d8462f313ea4999af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f77cc7a-2a", "ovs_interfaceid": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d8:93,bridge_name='br-int',has_traffic_filtering=True,id=4f77cc7a-2a19-4f3c-bbd4-d74d36912c91,network=Network(7de5f7dc-2d57-44b1-abd9-e135d7a3428b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f77cc7a-2a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG os_vif [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d8:93,bridge_name='br-int',has_traffic_filtering=True,id=4f77cc7a-2a19-4f3c-bbd4-d74d36912c91,network=Network(7de5f7dc-2d57-44b1-abd9-e135d7a3428b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f77cc7a-2a') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '677c0ae2-1c31-5221-a2b5-b8d769891538', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d34b47ee-89ed-4ad6-b207-0e3aaff2bf4e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f77cc7a-2a, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f77cc7a-2a, col_values=(('qos', UUID('0ff0e03e-b3e3-4fe5-9d75-01589f4798cd')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f77cc7a-2a, col_values=(('external_ids', {'iface-id': '4f77cc7a-2a19-4f3c-bbd4-d74d36912c91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:d8:93', 'vm-uuid': '22d30cdf-c6b3-4cf1-8caa-80223f9fe3af'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] No waiting events found dispatching network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:43:59 user nova-compute[80928]: WARNING nova.compute.manager [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received unexpected event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Received event network-changed-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Refreshing instance network info cache due to event network-changed-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] Acquiring lock "refresh_cache-22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] Acquired lock "refresh_cache-22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG nova.network.neutron [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Refreshing network info cache for port 4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:43:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:43:59 user nova-compute[80928]: INFO os_vif [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d8:93,bridge_name='br-int',has_traffic_filtering=True,id=4f77cc7a-2a19-4f3c-bbd4-d74d36912c91,network=Network(7de5f7dc-2d57-44b1-abd9-e135d7a3428b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f77cc7a-2a')
Nov 16 05:44:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:44:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No VIF found with MAC fa:16:3e:fa:d8:93, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:44:00 user nova-compute[80928]: DEBUG nova.network.neutron [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Updated VIF entry in instance network info cache for port 4f77cc7a-2a19-4f3c-bbd4-d74d36912c91. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:44:00 user nova-compute[80928]: DEBUG nova.network.neutron [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Updating instance_info_cache with network_info: [{"id": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "address": "fa:16:3e:fa:d8:93", "network": {"id": "7de5f7dc-2d57-44b1-abd9-e135d7a3428b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-448110210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64c114702dc14f2d8462f313ea4999af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f77cc7a-2a", "ovs_interfaceid": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:44:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-29b25e6c-79c2-4584-b018-50ecea85f599 req-64e6ceab-6642-4933-8935-5bb42de9019b service nova] Releasing lock "refresh_cache-22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:44:00 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:44:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-55fec314-f1c3-4852-8a95-a2a72890513a req-bcfe7b02-9839-43a5-a67e-01361206ddf7 service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Received event network-vif-plugged-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:44:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-55fec314-f1c3-4852-8a95-a2a72890513a req-bcfe7b02-9839-43a5-a67e-01361206ddf7 service nova] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-55fec314-f1c3-4852-8a95-a2a72890513a req-bcfe7b02-9839-43a5-a67e-01361206ddf7 service nova] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-55fec314-f1c3-4852-8a95-a2a72890513a req-bcfe7b02-9839-43a5-a67e-01361206ddf7 service nova] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-55fec314-f1c3-4852-8a95-a2a72890513a req-bcfe7b02-9839-43a5-a67e-01361206ddf7 service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] No waiting events found dispatching network-vif-plugged-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:44:01 user nova-compute[80928]: WARNING nova.compute.manager [req-55fec314-f1c3-4852-8a95-a2a72890513a req-bcfe7b02-9839-43a5-a67e-01361206ddf7 service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Received unexpected event network-vif-plugged-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 for instance with vm_state building and task_state spawning.
Nov 16 05:44:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:44:03 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Instance spawned successfully.
Nov 16 05:44:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-903c9066-5018-42fb-a443-09d2ccd32460 req-3e5e846c-5a23-45d6-9307-bffe2a167576 service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Received event network-vif-plugged-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-903c9066-5018-42fb-a443-09d2ccd32460 req-3e5e846c-5a23-45d6-9307-bffe2a167576 service nova] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-903c9066-5018-42fb-a443-09d2ccd32460 req-3e5e846c-5a23-45d6-9307-bffe2a167576 service nova] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-903c9066-5018-42fb-a443-09d2ccd32460 req-3e5e846c-5a23-45d6-9307-bffe2a167576 service nova] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-903c9066-5018-42fb-a443-09d2ccd32460 req-3e5e846c-5a23-45d6-9307-bffe2a167576 service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] No waiting events found dispatching network-vif-plugged-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:44:03 user nova-compute[80928]: WARNING nova.compute.manager [req-903c9066-5018-42fb-a443-09d2ccd32460 req-3e5e846c-5a23-45d6-9307-bffe2a167576 service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Received unexpected event network-vif-plugged-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 for instance with vm_state building and task_state spawning.
Nov 16 05:44:03 user nova-compute[80928]: INFO nova.compute.manager [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 16 05:44:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:44:03 user nova-compute[80928]: INFO nova.compute.manager [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Took 6.40 seconds to build instance.
Nov 16 05:44:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-276f1f7a-ef7a-48a9-b086-de4aa2c6a642 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.494s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:44:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "48435326-337f-4a1f-b213-d6726dc8d874" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:05 user nova-compute[80928]: INFO nova.compute.manager [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Unshelving
Nov 16 05:44:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:05 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'pci_requests' on Instance uuid 48435326-337f-4a1f-b213-d6726dc8d874 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:44:05 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'numa_topology' on Instance uuid 48435326-337f-4a1f-b213-d6726dc8d874 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:44:05 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:44:05 user nova-compute[80928]: INFO nova.compute.claims [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Claim successful on node user
Nov 16 05:44:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:44:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:44:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:06 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:44:06 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:44:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:06 user nova-compute[80928]: INFO nova.network.neutron [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Updating port 23245452-d757-4f54-bd1f-ad857f7c25da with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 05:44:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:44:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:44:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:44:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquired lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:44:06 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:44:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-069ce79f-d4b7-430d-9027-81006a906f8f req-bbd281e6-aaa9-43dc-b3a1-69edefba4379 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-changed-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:44:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-069ce79f-d4b7-430d-9027-81006a906f8f req-bbd281e6-aaa9-43dc-b3a1-69edefba4379 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Refreshing instance network info cache due to event network-changed-23245452-d757-4f54-bd1f-ad857f7c25da. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:44:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-069ce79f-d4b7-430d-9027-81006a906f8f req-bbd281e6-aaa9-43dc-b3a1-69edefba4379 service nova] Acquiring lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Updating instance_info_cache with network_info: [{"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Releasing lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:44:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Creating image(s)
Nov 16 05:44:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "/opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "/opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "/opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'trusted_certs' on Instance uuid 48435326-337f-4a1f-b213-d6726dc8d874 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-069ce79f-d4b7-430d-9027-81006a906f8f req-bbd281e6-aaa9-43dc-b3a1-69edefba4379 service nova] Acquired lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG nova.network.neutron [req-069ce79f-d4b7-430d-9027-81006a906f8f req-bbd281e6-aaa9-43dc-b3a1-69edefba4379 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Refreshing network info cache for port 23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG nova.objects.base [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Object Instance<48435326-337f-4a1f-b213-d6726dc8d874> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Updating instance_info_cache with network_info: [{"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-a39e1ed9-2651-4de2-8979-c030b02b0ee1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:44:07 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:44:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc.part --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:08 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:44:08 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:44:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:08 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:44:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc.part --force-share --output=json" returned: 0 in 0.217s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:08 user nova-compute[80928]: DEBUG nova.virt.images [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] 5ac5ba96-a67b-4e81-9f2e-85f00152b7bc was qcow2, converting to raw {{(pid=80928) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 05:44:08 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:44:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc.part /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc.converted {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-069ce79f-d4b7-430d-9027-81006a906f8f req-bbd281e6-aaa9-43dc-b3a1-69edefba4379 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Updated VIF entry in instance network info cache for port 23245452-d757-4f54-bd1f-ad857f7c25da. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG nova.network.neutron [req-069ce79f-d4b7-430d-9027-81006a906f8f req-bbd281e6-aaa9-43dc-b3a1-69edefba4379 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Updating instance_info_cache with network_info: [{"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-069ce79f-d4b7-430d-9027-81006a906f8f req-bbd281e6-aaa9-43dc-b3a1-69edefba4379 service nova] Releasing lock "refresh_cache-48435326-337f-4a1f-b213-d6726dc8d874" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc.part /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc.converted" returned: 0 in 0.268s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc.converted --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.925s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc --force-share --output=json" returned: 0 in 0.192s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc,backing_fmt=raw /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc,backing_fmt=raw /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk 1073741824" returned: 0 in 0.055s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc --force-share --output=json" returned: 0 in 0.210s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'migration_context' on Instance uuid 48435326-337f-4a1f-b213-d6726dc8d874 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG nova.objects.base [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Object Instance<48435326-337f-4a1f-b213-d6726dc8d874> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:44:10 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Rebasing disk image.
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 -F raw /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:44:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.296s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "765e9a3f-b188-483c-b149-2df53766fed8" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.005s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Going to confirm migration 2 {{(pid=80928) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.778s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 -F raw /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk" returned: 0 in 2.409s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Ensure instance console log exists: /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Start _get_guest_xml network_info=[{"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3e867151f334133099e6e26bb8343f37',container_format='bare',created_at=2023-11-16T05:42:12Z,direct_url=<?>,disk_format='qcow2',id=5ac5ba96-a67b-4e81-9f2e-85f00152b7bc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1026899600-shelved',owner='9efdd13a65f44182a910ecf45bf27116',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T05:42:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:44:12 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:44:12 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3e867151f334133099e6e26bb8343f37',container_format='bare',created_at=2023-11-16T05:42:12Z,direct_url=<?>,disk_format='qcow2',id=5ac5ba96-a67b-4e81-9f2e-85f00152b7bc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1026899600-shelved',owner='9efdd13a65f44182a910ecf45bf27116',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T05:42:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'vcpu_model' on Instance uuid 48435326-337f-4a1f-b213-d6726dc8d874 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.objects.base [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Object Instance<48435326-337f-4a1f-b213-d6726dc8d874> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1026899600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1026899600',id=29,image_ref='5ac5ba96-a67b-4e81-9f2e-85f00152b7bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-851703054',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9efdd13a65f44182a910ecf45bf27116',ramdisk_id='',reservation_id='r-c0ou62pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-658694431',owner_user_name='tempest-AttachVolumeShelveTestJSON-658694431-project-member',shelved_at='2023-11-16T05:42:16.977431',shelved_host='user',shelved_image_id='5ac5ba96-a67b-4e81-9f2e-85f00152b7bc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:44:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='505358920a9e43c59cf29b85ffbccb95',uuid=48435326-337f-4a1f-b213-d6726dc8d874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converting VIF {"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'pci_devices' on Instance uuid 48435326-337f-4a1f-b213-d6726dc8d874 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.objects.base [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Object Instance<48435326-337f-4a1f-b213-d6726dc8d874> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:44:12 user nova-compute[80928]:   <uuid>48435326-337f-4a1f-b213-d6726dc8d874</uuid>
Nov 16 05:44:12 user nova-compute[80928]:   <name>instance-0000001d</name>
Nov 16 05:44:12 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:44:12 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:44:12 user nova-compute[80928]:   <metadata>
Nov 16 05:44:12 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:44:12 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:44:12 user nova-compute[80928]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1026899600</nova:name>
Nov 16 05:44:12 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:44:12</nova:creationTime>
Nov 16 05:44:12 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:44:12 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:44:12 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:44:12 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:44:12 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:44:12 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:44:12 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:44:12 user nova-compute[80928]:       <nova:owner>
Nov 16 05:44:12 user nova-compute[80928]:         <nova:user uuid="505358920a9e43c59cf29b85ffbccb95">tempest-AttachVolumeShelveTestJSON-658694431-project-member</nova:user>
Nov 16 05:44:12 user nova-compute[80928]:         <nova:project uuid="9efdd13a65f44182a910ecf45bf27116">tempest-AttachVolumeShelveTestJSON-658694431</nova:project>
Nov 16 05:44:12 user nova-compute[80928]:       </nova:owner>
Nov 16 05:44:12 user nova-compute[80928]:       <nova:root type="image" uuid="5ac5ba96-a67b-4e81-9f2e-85f00152b7bc"/>
Nov 16 05:44:12 user nova-compute[80928]:       <nova:ports>
Nov 16 05:44:12 user nova-compute[80928]:         <nova:port uuid="23245452-d757-4f54-bd1f-ad857f7c25da">
Nov 16 05:44:12 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 05:44:12 user nova-compute[80928]:         </nova:port>
Nov 16 05:44:12 user nova-compute[80928]:       </nova:ports>
Nov 16 05:44:12 user nova-compute[80928]:     </nova:instance>
Nov 16 05:44:12 user nova-compute[80928]:   </metadata>
Nov 16 05:44:12 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:44:12 user nova-compute[80928]:     <system>
Nov 16 05:44:12 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:44:12 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:44:12 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:44:12 user nova-compute[80928]:       <entry name="serial">48435326-337f-4a1f-b213-d6726dc8d874</entry>
Nov 16 05:44:12 user nova-compute[80928]:       <entry name="uuid">48435326-337f-4a1f-b213-d6726dc8d874</entry>
Nov 16 05:44:12 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:44:12 user nova-compute[80928]:     </system>
Nov 16 05:44:12 user nova-compute[80928]:   </sysinfo>
Nov 16 05:44:12 user nova-compute[80928]:   <os>
Nov 16 05:44:12 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:44:12 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:44:12 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:44:12 user nova-compute[80928]:   </os>
Nov 16 05:44:12 user nova-compute[80928]:   <features>
Nov 16 05:44:12 user nova-compute[80928]:     <acpi/>
Nov 16 05:44:12 user nova-compute[80928]:     <apic/>
Nov 16 05:44:12 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:44:12 user nova-compute[80928]:   </features>
Nov 16 05:44:12 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:44:12 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:44:12 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:44:12 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:44:12 user nova-compute[80928]:   </clock>
Nov 16 05:44:12 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:44:12 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:44:12 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:44:12 user nova-compute[80928]:   </cpu>
Nov 16 05:44:12 user nova-compute[80928]:   <devices>
Nov 16 05:44:12 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:44:12 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:44:12 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk"/>
Nov 16 05:44:12 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:44:12 user nova-compute[80928]:     </disk>
Nov 16 05:44:12 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:44:12 user nova-compute[80928]:       <mac address="fa:16:3e:4e:5d:e2"/>
Nov 16 05:44:12 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:44:12 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:44:12 user nova-compute[80928]:       <target dev="tap23245452-d7"/>
Nov 16 05:44:12 user nova-compute[80928]:     </interface>
Nov 16 05:44:12 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:44:12 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/console.log" append="off"/>
Nov 16 05:44:12 user nova-compute[80928]:     </serial>
Nov 16 05:44:12 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:44:12 user nova-compute[80928]:     <video>
Nov 16 05:44:12 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:44:12 user nova-compute[80928]:     </video>
Nov 16 05:44:12 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:44:12 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:44:12 user nova-compute[80928]:     </rng>
Nov 16 05:44:12 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:44:12 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:44:12 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:44:12 user nova-compute[80928]:     </memballoon>
Nov 16 05:44:12 user nova-compute[80928]:   </devices>
Nov 16 05:44:12 user nova-compute[80928]: </domain>
Nov 16 05:44:12 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1026899600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1026899600',id=29,image_ref='5ac5ba96-a67b-4e81-9f2e-85f00152b7bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-851703054',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9efdd13a65f44182a910ecf45bf27116',ramdisk_id='',reservation_id='r-c0ou62pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-658694431',owner_user_name='tempest-AttachVolumeShelveTestJSON-658694431-project-member',shelved_at='2023-11-16T05:42:16.977431',shelved_host='user',shelved_image_id='5ac5ba96-a67b-4e81-9f2e-85f00152b7bc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:44:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='505358920a9e43c59cf29b85ffbccb95',uuid=48435326-337f-4a1f-b213-d6726dc8d874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converting VIF {"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG os_vif [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63c464bc-d071-5021-956a-a43ecb4c3d8a', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23245452-d7, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23245452-d7, col_values=(('qos', UUID('922168b4-c994-418f-9e1a-09c22c97b49d')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23245452-d7, col_values=(('external_ids', {'iface-id': '23245452-d757-4f54-bd1f-ad857f7c25da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:5d:e2', 'vm-uuid': '48435326-337f-4a1f-b213-d6726dc8d874'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquired lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:44:12 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lazy-loading 'info_cache' on Instance uuid 765e9a3f-b188-483c-b149-2df53766fed8 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:44:12 user nova-compute[80928]: INFO os_vif [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7')
Nov 16 05:44:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:44:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] No VIF found with MAC fa:16:3e:4e:5d:e2, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:44:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.manager [req-ffd6cad8-9597-440e-98c7-edde9fc64161 req-7df5be10-aa49-4125-a7b9-2b9a08bb0e7d service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ffd6cad8-9597-440e-98c7-edde9fc64161 req-7df5be10-aa49-4125-a7b9-2b9a08bb0e7d service nova] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ffd6cad8-9597-440e-98c7-edde9fc64161 req-7df5be10-aa49-4125-a7b9-2b9a08bb0e7d service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ffd6cad8-9597-440e-98c7-edde9fc64161 req-7df5be10-aa49-4125-a7b9-2b9a08bb0e7d service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.manager [req-ffd6cad8-9597-440e-98c7-edde9fc64161 req-7df5be10-aa49-4125-a7b9-2b9a08bb0e7d service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] No waiting events found dispatching network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:44:17 user nova-compute[80928]: WARNING nova.compute.manager [req-ffd6cad8-9597-440e-98c7-edde9fc64161 req-7df5be10-aa49-4125-a7b9-2b9a08bb0e7d service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received unexpected event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.manager [req-08527525-c3ce-434b-91b7-ef7897428579 req-b0cd4fc2-d224-4097-aed3-9b0eebed4058 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-08527525-c3ce-434b-91b7-ef7897428579 req-b0cd4fc2-d224-4097-aed3-9b0eebed4058 service nova] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-08527525-c3ce-434b-91b7-ef7897428579 req-b0cd4fc2-d224-4097-aed3-9b0eebed4058 service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-08527525-c3ce-434b-91b7-ef7897428579 req-b0cd4fc2-d224-4097-aed3-9b0eebed4058 service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.manager [req-08527525-c3ce-434b-91b7-ef7897428579 req-b0cd4fc2-d224-4097-aed3-9b0eebed4058 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] No waiting events found dispatching network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:44:17 user nova-compute[80928]: WARNING nova.compute.manager [req-08527525-c3ce-434b-91b7-ef7897428579 req-b0cd4fc2-d224-4097-aed3-9b0eebed4058 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received unexpected event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 05:44:17 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:44:17 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7961MB free_disk=25.100284576416016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:17 user nova-compute[80928]: INFO nova.compute.manager [None req-e376f5b2-e1c0-4a07-9fc7-26e7cc0f97a4 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Unrescuing
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e376f5b2-e1c0-4a07-9fc7-26e7cc0f97a4 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "refresh_cache-0a2fc694-8d82-4f4b-971d-18454c975fcd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e376f5b2-e1c0-4a07-9fc7-26e7cc0f97a4 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquired lock "refresh_cache-0a2fc694-8d82-4f4b-971d-18454c975fcd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e376f5b2-e1c0-4a07-9fc7-26e7cc0f97a4 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:44:17 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Instance spawned successfully.
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Applying migration context for instance 765e9a3f-b188-483c-b149-2df53766fed8 as it has an incoming, in-progress migration 08f41834-fa95-4095-babf-4b53e74b9cf4. Migration status is confirming {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 05:44:17 user nova-compute[80928]: INFO nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updating resource usage from migration 08f41834-fa95-4095-babf-4b53e74b9cf4
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 310c7fc9-af32-42dd-be30-8460daa03279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 0a2fc694-8d82-4f4b-971d-18454c975fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Migration 08f41834-fa95-4095-babf-4b53e74b9cf4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 765e9a3f-b188-483c-b149-2df53766fed8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (7c2bca45-4d73-4fca-baf6-06c1e78dcd4e): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updating instance_info_cache with network_info: [{"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ea9d9a62-afa9-49c0-89a5-fde94b9414d9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "48435326-337f-4a1f-b213-d6726dc8d874" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.455s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Releasing lock "refresh_cache-765e9a3f-b188-483c-b149-2df53766fed8" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lazy-loading 'migration_context' on Instance uuid 765e9a3f-b188-483c-b149-2df53766fed8 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.objects.base [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Object Instance<765e9a3f-b188-483c-b149-2df53766fed8> lazy-loaded attributes: info_cache,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.713s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.205s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e376f5b2-e1c0-4a07-9fc7-26e7cc0f97a4 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Updating instance_info_cache with network_info: [{"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e376f5b2-e1c0-4a07-9fc7-26e7cc0f97a4 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Releasing lock "refresh_cache-0a2fc694-8d82-4f4b-971d-18454c975fcd" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e376f5b2-e1c0-4a07-9fc7-26e7cc0f97a4 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'flavor' on Instance uuid 0a2fc694-8d82-4f4b-971d-18454c975fcd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Acquiring lock "d06f80f3-1989-4d33-bc1e-d9674292e0de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.570s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:44:18 user nova-compute[80928]: INFO nova.compute.claims [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Claim successful on node user
Nov 16 05:44:18 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Deleted allocation for migration 08f41834-fa95-4095-babf-4b53e74b9cf4
Nov 16 05:44:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e536db4a-5811-476a-8450-aaa68faf6aa1 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "765e9a3f-b188-483c-b149-2df53766fed8" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 6.185s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Instance destroyed successfully.
Nov 16 05:44:19 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:44:19 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:44:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG nova.policy [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31f326ea3728485f9b277a5643a2d1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c1a9b85bf24c9e99b230ce10c6c2fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:44:19 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Creating image(s)
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Acquiring lock "/opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "/opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "/opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.201s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.201s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk 1073741824" returned: 0 in 0.070s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Successfully created port: 926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:44:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.200s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Cannot resize image /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Ensure instance console log exists: /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Successfully updated port: 926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Acquiring lock "refresh_cache-d06f80f3-1989-4d33-bc1e-d9674292e0de" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Acquired lock "refresh_cache-d06f80f3-1989-4d33-bc1e-d9674292e0de" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-2f83852e-282d-4629-b25c-d888e532a131 req-45027b4d-0bbe-4a20-8442-1e82d351dd3e service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Received event network-changed-926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-2f83852e-282d-4629-b25c-d888e532a131 req-45027b4d-0bbe-4a20-8442-1e82d351dd3e service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Refreshing instance network info cache due to event network-changed-926957a7-9fae-4eb3-947e-88e4a11abbb7. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2f83852e-282d-4629-b25c-d888e532a131 req-45027b4d-0bbe-4a20-8442-1e82d351dd3e service nova] Acquiring lock "refresh_cache-d06f80f3-1989-4d33-bc1e-d9674292e0de" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.network.neutron [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Updating instance_info_cache with network_info: [{"id": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "address": "fa:16:3e:a0:6f:74", "network": {"id": "59f6784a-8503-45d2-8983-7db030135e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495559584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a9b85bf24c9e99b230ce10c6c2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926957a7-9f", "ovs_interfaceid": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Releasing lock "refresh_cache-d06f80f3-1989-4d33-bc1e-d9674292e0de" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Instance network_info: |[{"id": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "address": "fa:16:3e:a0:6f:74", "network": {"id": "59f6784a-8503-45d2-8983-7db030135e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495559584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a9b85bf24c9e99b230ce10c6c2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926957a7-9f", "ovs_interfaceid": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2f83852e-282d-4629-b25c-d888e532a131 req-45027b4d-0bbe-4a20-8442-1e82d351dd3e service nova] Acquired lock "refresh_cache-d06f80f3-1989-4d33-bc1e-d9674292e0de" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.network.neutron [req-2f83852e-282d-4629-b25c-d888e532a131 req-45027b4d-0bbe-4a20-8442-1e82d351dd3e service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Refreshing network info cache for port 926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:44:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Start _get_guest_xml network_info=[{"id": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "address": "fa:16:3e:a0:6f:74", "network": {"id": "59f6784a-8503-45d2-8983-7db030135e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495559584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a9b85bf24c9e99b230ce10c6c2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926957a7-9f", "ovs_interfaceid": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:44:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:44:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2004734221',display_name='tempest-VolumesActionsTest-instance-2004734221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2004734221',id=33,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c1a9b85bf24c9e99b230ce10c6c2fb',ramdisk_id='',reservation_id='r-751z88nj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1976056621',owner_user_name='tempest-VolumesActionsTest-1976056621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:44:19Z,user_data=None,user_id='31f326ea3728485f9b277a5643a2d1e1',uuid=d06f80f3-1989-4d33-bc1e-d9674292e0de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "address": "fa:16:3e:a0:6f:74", "network": {"id": "59f6784a-8503-45d2-8983-7db030135e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495559584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a9b85bf24c9e99b230ce10c6c2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926957a7-9f", "ovs_interfaceid": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Converting VIF {"id": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "address": "fa:16:3e:a0:6f:74", "network": {"id": "59f6784a-8503-45d2-8983-7db030135e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495559584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a9b85bf24c9e99b230ce10c6c2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926957a7-9f", "ovs_interfaceid": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:74,bridge_name='br-int',has_traffic_filtering=True,id=926957a7-9fae-4eb3-947e-88e4a11abbb7,network=Network(59f6784a-8503-45d2-8983-7db030135e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926957a7-9f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.objects.instance [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lazy-loading 'pci_devices' on Instance uuid d06f80f3-1989-4d33-bc1e-d9674292e0de {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:44:21 user nova-compute[80928]:   <uuid>d06f80f3-1989-4d33-bc1e-d9674292e0de</uuid>
Nov 16 05:44:21 user nova-compute[80928]:   <name>instance-00000021</name>
Nov 16 05:44:21 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:44:21 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:44:21 user nova-compute[80928]:   <metadata>
Nov 16 05:44:21 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:44:21 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:44:21 user nova-compute[80928]:       <nova:name>tempest-VolumesActionsTest-instance-2004734221</nova:name>
Nov 16 05:44:21 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:44:21</nova:creationTime>
Nov 16 05:44:21 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:44:21 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:44:21 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:44:21 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:44:21 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:44:21 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:44:21 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:44:21 user nova-compute[80928]:       <nova:owner>
Nov 16 05:44:21 user nova-compute[80928]:         <nova:user uuid="31f326ea3728485f9b277a5643a2d1e1">tempest-VolumesActionsTest-1976056621-project-member</nova:user>
Nov 16 05:44:21 user nova-compute[80928]:         <nova:project uuid="d5c1a9b85bf24c9e99b230ce10c6c2fb">tempest-VolumesActionsTest-1976056621</nova:project>
Nov 16 05:44:21 user nova-compute[80928]:       </nova:owner>
Nov 16 05:44:21 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:44:21 user nova-compute[80928]:       <nova:ports>
Nov 16 05:44:21 user nova-compute[80928]:         <nova:port uuid="926957a7-9fae-4eb3-947e-88e4a11abbb7">
Nov 16 05:44:21 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 05:44:21 user nova-compute[80928]:         </nova:port>
Nov 16 05:44:21 user nova-compute[80928]:       </nova:ports>
Nov 16 05:44:21 user nova-compute[80928]:     </nova:instance>
Nov 16 05:44:21 user nova-compute[80928]:   </metadata>
Nov 16 05:44:21 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:44:21 user nova-compute[80928]:     <system>
Nov 16 05:44:21 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:44:21 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:44:21 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:44:21 user nova-compute[80928]:       <entry name="serial">d06f80f3-1989-4d33-bc1e-d9674292e0de</entry>
Nov 16 05:44:21 user nova-compute[80928]:       <entry name="uuid">d06f80f3-1989-4d33-bc1e-d9674292e0de</entry>
Nov 16 05:44:21 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:44:21 user nova-compute[80928]:     </system>
Nov 16 05:44:21 user nova-compute[80928]:   </sysinfo>
Nov 16 05:44:21 user nova-compute[80928]:   <os>
Nov 16 05:44:21 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:44:21 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:44:21 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:44:21 user nova-compute[80928]:   </os>
Nov 16 05:44:21 user nova-compute[80928]:   <features>
Nov 16 05:44:21 user nova-compute[80928]:     <acpi/>
Nov 16 05:44:21 user nova-compute[80928]:     <apic/>
Nov 16 05:44:21 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:44:21 user nova-compute[80928]:   </features>
Nov 16 05:44:21 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:44:21 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:44:21 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:44:21 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:44:21 user nova-compute[80928]:   </clock>
Nov 16 05:44:21 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:44:21 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:44:21 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:44:21 user nova-compute[80928]:   </cpu>
Nov 16 05:44:21 user nova-compute[80928]:   <devices>
Nov 16 05:44:21 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:44:21 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:44:21 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk"/>
Nov 16 05:44:21 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:44:21 user nova-compute[80928]:     </disk>
Nov 16 05:44:21 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:44:21 user nova-compute[80928]:       <mac address="fa:16:3e:a0:6f:74"/>
Nov 16 05:44:21 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:44:21 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:44:21 user nova-compute[80928]:       <target dev="tap926957a7-9f"/>
Nov 16 05:44:21 user nova-compute[80928]:     </interface>
Nov 16 05:44:21 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:44:21 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/console.log" append="off"/>
Nov 16 05:44:21 user nova-compute[80928]:     </serial>
Nov 16 05:44:21 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:44:21 user nova-compute[80928]:     <video>
Nov 16 05:44:21 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:44:21 user nova-compute[80928]:     </video>
Nov 16 05:44:21 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:44:21 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:44:21 user nova-compute[80928]:     </rng>
Nov 16 05:44:21 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:44:21 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:44:21 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:44:21 user nova-compute[80928]:     </memballoon>
Nov 16 05:44:21 user nova-compute[80928]:   </devices>
Nov 16 05:44:21 user nova-compute[80928]: </domain>
Nov 16 05:44:21 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2004734221',display_name='tempest-VolumesActionsTest-instance-2004734221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2004734221',id=33,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c1a9b85bf24c9e99b230ce10c6c2fb',ramdisk_id='',reservation_id='r-751z88nj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1976056621',owner_user_name='tempest-VolumesActionsTest-1976056621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:44:19Z,user_data=None,user_id='31f326ea3728485f9b277a5643a2d1e1',uuid=d06f80f3-1989-4d33-bc1e-d9674292e0de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "address": "fa:16:3e:a0:6f:74", "network": {"id": "59f6784a-8503-45d2-8983-7db030135e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495559584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a9b85bf24c9e99b230ce10c6c2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926957a7-9f", "ovs_interfaceid": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Converting VIF {"id": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "address": "fa:16:3e:a0:6f:74", "network": {"id": "59f6784a-8503-45d2-8983-7db030135e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495559584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a9b85bf24c9e99b230ce10c6c2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926957a7-9f", "ovs_interfaceid": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:74,bridge_name='br-int',has_traffic_filtering=True,id=926957a7-9fae-4eb3-947e-88e4a11abbb7,network=Network(59f6784a-8503-45d2-8983-7db030135e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926957a7-9f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG os_vif [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:74,bridge_name='br-int',has_traffic_filtering=True,id=926957a7-9fae-4eb3-947e-88e4a11abbb7,network=Network(59f6784a-8503-45d2-8983-7db030135e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926957a7-9f') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b247e70-3670-5232-8dcf-e8660e8d532c', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap926957a7-9f, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap926957a7-9f, col_values=(('qos', UUID('39acd932-3bba-4ac1-b990-c8bb62daa861')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap926957a7-9f, col_values=(('external_ids', {'iface-id': '926957a7-9fae-4eb3-947e-88e4a11abbb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:6f:74', 'vm-uuid': 'd06f80f3-1989-4d33-bc1e-d9674292e0de'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:21 user nova-compute[80928]: INFO os_vif [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:74,bridge_name='br-int',has_traffic_filtering=True,id=926957a7-9fae-4eb3-947e-88e4a11abbb7,network=Network(59f6784a-8503-45d2-8983-7db030135e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926957a7-9f')
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] No VIF found with MAC fa:16:3e:a0:6f:74, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.network.neutron [req-2f83852e-282d-4629-b25c-d888e532a131 req-45027b4d-0bbe-4a20-8442-1e82d351dd3e service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Updated VIF entry in instance network info cache for port 926957a7-9fae-4eb3-947e-88e4a11abbb7. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.network.neutron [req-2f83852e-282d-4629-b25c-d888e532a131 req-45027b4d-0bbe-4a20-8442-1e82d351dd3e service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Updating instance_info_cache with network_info: [{"id": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "address": "fa:16:3e:a0:6f:74", "network": {"id": "59f6784a-8503-45d2-8983-7db030135e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495559584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a9b85bf24c9e99b230ce10c6c2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926957a7-9f", "ovs_interfaceid": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2f83852e-282d-4629-b25c-d888e532a131 req-45027b4d-0bbe-4a20-8442-1e82d351dd3e service nova] Releasing lock "refresh_cache-d06f80f3-1989-4d33-bc1e-d9674292e0de" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.compute.manager [req-0d81db8f-484f-4be4-a304-30ea34e532f5 req-eea74e5b-d93d-4626-bbeb-1dbd900a8ccf service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-unplugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0d81db8f-484f-4be4-a304-30ea34e532f5 req-eea74e5b-d93d-4626-bbeb-1dbd900a8ccf service nova] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0d81db8f-484f-4be4-a304-30ea34e532f5 req-eea74e5b-d93d-4626-bbeb-1dbd900a8ccf service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0d81db8f-484f-4be4-a304-30ea34e532f5 req-eea74e5b-d93d-4626-bbeb-1dbd900a8ccf service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:21 user nova-compute[80928]: DEBUG nova.compute.manager [req-0d81db8f-484f-4be4-a304-30ea34e532f5 req-eea74e5b-d93d-4626-bbeb-1dbd900a8ccf service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] No waiting events found dispatching network-vif-unplugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:44:21 user nova-compute[80928]: WARNING nova.compute.manager [req-0d81db8f-484f-4be4-a304-30ea34e532f5 req-eea74e5b-d93d-4626-bbeb-1dbd900a8ccf service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received unexpected event network-vif-unplugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:44:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e376f5b2-e1c0-4a07-9fc7-26e7cc0f97a4 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:44:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-a9f7bf20-a217-4c82-bf28-a54776be3d30 req-6ed6104e-67ca-4c5f-84bf-c4366691c929 service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Received event network-vif-plugged-926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:44:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a9f7bf20-a217-4c82-bf28-a54776be3d30 req-6ed6104e-67ca-4c5f-84bf-c4366691c929 service nova] Acquiring lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a9f7bf20-a217-4c82-bf28-a54776be3d30 req-6ed6104e-67ca-4c5f-84bf-c4366691c929 service nova] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a9f7bf20-a217-4c82-bf28-a54776be3d30 req-6ed6104e-67ca-4c5f-84bf-c4366691c929 service nova] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-a9f7bf20-a217-4c82-bf28-a54776be3d30 req-6ed6104e-67ca-4c5f-84bf-c4366691c929 service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] No waiting events found dispatching network-vif-plugged-926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:44:22 user nova-compute[80928]: WARNING nova.compute.manager [req-a9f7bf20-a217-4c82-bf28-a54776be3d30 req-6ed6104e-67ca-4c5f-84bf-c4366691c929 service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Received unexpected event network-vif-plugged-926957a7-9fae-4eb3-947e-88e4a11abbb7 for instance with vm_state building and task_state spawning.
Nov 16 05:44:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] No waiting events found dispatching network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:44:24 user nova-compute[80928]: WARNING nova.compute.manager [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received unexpected event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c for instance with vm_state active and task_state None.
Nov 16 05:44:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] No waiting events found dispatching network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:44:24 user nova-compute[80928]: WARNING nova.compute.manager [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received unexpected event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c for instance with vm_state active and task_state None.
Nov 16 05:44:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] No waiting events found dispatching network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:44:24 user nova-compute[80928]: WARNING nova.compute.manager [req-ffe81112-7354-41be-9755-03577cd6f55d req-6fb563ba-5a76-4f4d-95d3-918ec68e20db service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received unexpected event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c for instance with vm_state active and task_state None.
Nov 16 05:44:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-159c40d1-431f-461e-a7f0-2732d749dae0 req-1d922087-cb3d-4145-91f2-f596ca31bf4e service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Received event network-vif-plugged-926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-159c40d1-431f-461e-a7f0-2732d749dae0 req-1d922087-cb3d-4145-91f2-f596ca31bf4e service nova] Acquiring lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-159c40d1-431f-461e-a7f0-2732d749dae0 req-1d922087-cb3d-4145-91f2-f596ca31bf4e service nova] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-159c40d1-431f-461e-a7f0-2732d749dae0 req-1d922087-cb3d-4145-91f2-f596ca31bf4e service nova] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-159c40d1-431f-461e-a7f0-2732d749dae0 req-1d922087-cb3d-4145-91f2-f596ca31bf4e service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] No waiting events found dispatching network-vif-plugged-926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:44:24 user nova-compute[80928]: WARNING nova.compute.manager [req-159c40d1-431f-461e-a7f0-2732d749dae0 req-1d922087-cb3d-4145-91f2-f596ca31bf4e service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Received unexpected event network-vif-plugged-926957a7-9fae-4eb3-947e-88e4a11abbb7 for instance with vm_state building and task_state spawning.
Nov 16 05:44:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:44:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:44:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Instance spawned successfully.
Nov 16 05:44:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:44:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:44:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:44:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:44:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:44:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:44:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:44:25 user nova-compute[80928]: INFO nova.compute.manager [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 16 05:44:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:44:25 user nova-compute[80928]: INFO nova.compute.manager [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Took 6.73 seconds to build instance.
Nov 16 05:44:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d8f13b1c-18ff-49b9-b554-921972089566 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.865s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:44:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:53 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:44:53 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances with incomplete migration  {{(pid=80928) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 05:44:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:44:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:07 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:45:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:45:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:45:07 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Updating instance_info_cache with network_info: [{"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:45:08 user nova-compute[80928]: INFO nova.compute.claims [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Claim successful on node user
Nov 16 05:45:08 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Refreshing inventories for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Updating ProviderTree inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Refreshing aggregate associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, aggregates: None {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 05:45:08 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Refreshing trait associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.466s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:45:09 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:45:09 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG nova.policy [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca7c6c355f6045b3b372b280e0f45293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2303337fe174f93801f18cd074276ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:45:09 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Creating image(s)
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "/opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "/opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk 1073741824" returned: 0 in 0.047s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Cannot resize image /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Ensure instance console log exists: /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG nova.network.neutron [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Successfully created port: 0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Successfully updated port: 0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquired lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.compute.manager [req-df5fc205-1b5c-4046-893b-5401784f64dc req-41c1c9e8-aa85-431c-a9b8-97daec037f00 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Received event network-changed-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.compute.manager [req-df5fc205-1b5c-4046-893b-5401784f64dc req-41c1c9e8-aa85-431c-a9b8-97daec037f00 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Refreshing instance network info cache due to event network-changed-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-df5fc205-1b5c-4046-893b-5401784f64dc req-41c1c9e8-aa85-431c-a9b8-97daec037f00 service nova] Acquiring lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Updating instance_info_cache with network_info: [{"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Releasing lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Instance network_info: |[{"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-df5fc205-1b5c-4046-893b-5401784f64dc req-41c1c9e8-aa85-431c-a9b8-97daec037f00 service nova] Acquired lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.network.neutron [req-df5fc205-1b5c-4046-893b-5401784f64dc req-41c1c9e8-aa85-431c-a9b8-97daec037f00 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Refreshing network info cache for port 0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Start _get_guest_xml network_info=[{"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:45:11 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:45:11 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1532977584',display_name='tempest-TestStampPattern-server-1532977584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1532977584',id=34,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLePRgjoHIwwFRskFVbkQTWicFJVZFVV6bqATDh63kS8WDDVk64Iwjsbx3COtxGzWdYj0GjKmGqFYJIuK4jxb9Hg6TfWNymS23NQpVvyf/ukUCfHQ63gwGXdG4hy01fL/A==',key_name='tempest-TestStampPattern-637785610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2303337fe174f93801f18cd074276ce',ramdisk_id='',reservation_id='r-1k1djk01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1909880958',owner_user_name='tempest-TestStampPattern-1909880958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:45:09Z,user_data=None,user_id='ca7c6c355f6045b3b372b280e0f45293',uuid=6cc61915-ab05-4f3c-80ff-b873ae3dc68a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Converting VIF {"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c7:4b,bridge_name='br-int',has_traffic_filtering=True,id=0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7e5f13-e7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.objects.instance [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cc61915-ab05-4f3c-80ff-b873ae3dc68a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:45:11 user nova-compute[80928]:   <uuid>6cc61915-ab05-4f3c-80ff-b873ae3dc68a</uuid>
Nov 16 05:45:11 user nova-compute[80928]:   <name>instance-00000022</name>
Nov 16 05:45:11 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:45:11 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:45:11 user nova-compute[80928]:   <metadata>
Nov 16 05:45:11 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:45:11 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:45:11 user nova-compute[80928]:       <nova:name>tempest-TestStampPattern-server-1532977584</nova:name>
Nov 16 05:45:11 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:45:11</nova:creationTime>
Nov 16 05:45:11 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:45:11 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:45:11 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:45:11 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:45:11 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:45:11 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:45:11 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:45:11 user nova-compute[80928]:       <nova:owner>
Nov 16 05:45:11 user nova-compute[80928]:         <nova:user uuid="ca7c6c355f6045b3b372b280e0f45293">tempest-TestStampPattern-1909880958-project-member</nova:user>
Nov 16 05:45:11 user nova-compute[80928]:         <nova:project uuid="e2303337fe174f93801f18cd074276ce">tempest-TestStampPattern-1909880958</nova:project>
Nov 16 05:45:11 user nova-compute[80928]:       </nova:owner>
Nov 16 05:45:11 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:45:11 user nova-compute[80928]:       <nova:ports>
Nov 16 05:45:11 user nova-compute[80928]:         <nova:port uuid="0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c">
Nov 16 05:45:11 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 05:45:11 user nova-compute[80928]:         </nova:port>
Nov 16 05:45:11 user nova-compute[80928]:       </nova:ports>
Nov 16 05:45:11 user nova-compute[80928]:     </nova:instance>
Nov 16 05:45:11 user nova-compute[80928]:   </metadata>
Nov 16 05:45:11 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:45:11 user nova-compute[80928]:     <system>
Nov 16 05:45:11 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:45:11 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:45:11 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:45:11 user nova-compute[80928]:       <entry name="serial">6cc61915-ab05-4f3c-80ff-b873ae3dc68a</entry>
Nov 16 05:45:11 user nova-compute[80928]:       <entry name="uuid">6cc61915-ab05-4f3c-80ff-b873ae3dc68a</entry>
Nov 16 05:45:11 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:45:11 user nova-compute[80928]:     </system>
Nov 16 05:45:11 user nova-compute[80928]:   </sysinfo>
Nov 16 05:45:11 user nova-compute[80928]:   <os>
Nov 16 05:45:11 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:45:11 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:45:11 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:45:11 user nova-compute[80928]:   </os>
Nov 16 05:45:11 user nova-compute[80928]:   <features>
Nov 16 05:45:11 user nova-compute[80928]:     <acpi/>
Nov 16 05:45:11 user nova-compute[80928]:     <apic/>
Nov 16 05:45:11 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:45:11 user nova-compute[80928]:   </features>
Nov 16 05:45:11 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:45:11 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:45:11 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:45:11 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:45:11 user nova-compute[80928]:   </clock>
Nov 16 05:45:11 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:45:11 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:45:11 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:45:11 user nova-compute[80928]:   </cpu>
Nov 16 05:45:11 user nova-compute[80928]:   <devices>
Nov 16 05:45:11 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:45:11 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:45:11 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk"/>
Nov 16 05:45:11 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:45:11 user nova-compute[80928]:     </disk>
Nov 16 05:45:11 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:45:11 user nova-compute[80928]:       <mac address="fa:16:3e:40:c7:4b"/>
Nov 16 05:45:11 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:45:11 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:45:11 user nova-compute[80928]:       <target dev="tap0b7e5f13-e7"/>
Nov 16 05:45:11 user nova-compute[80928]:     </interface>
Nov 16 05:45:11 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:45:11 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/console.log" append="off"/>
Nov 16 05:45:11 user nova-compute[80928]:     </serial>
Nov 16 05:45:11 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:45:11 user nova-compute[80928]:     <video>
Nov 16 05:45:11 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:45:11 user nova-compute[80928]:     </video>
Nov 16 05:45:11 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:45:11 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:45:11 user nova-compute[80928]:     </rng>
Nov 16 05:45:11 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:45:11 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:45:11 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:45:11 user nova-compute[80928]:     </memballoon>
Nov 16 05:45:11 user nova-compute[80928]:   </devices>
Nov 16 05:45:11 user nova-compute[80928]: </domain>
Nov 16 05:45:11 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1532977584',display_name='tempest-TestStampPattern-server-1532977584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1532977584',id=34,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLePRgjoHIwwFRskFVbkQTWicFJVZFVV6bqATDh63kS8WDDVk64Iwjsbx3COtxGzWdYj0GjKmGqFYJIuK4jxb9Hg6TfWNymS23NQpVvyf/ukUCfHQ63gwGXdG4hy01fL/A==',key_name='tempest-TestStampPattern-637785610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2303337fe174f93801f18cd074276ce',ramdisk_id='',reservation_id='r-1k1djk01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1909880958',owner_user_name='tempest-TestStampPattern-1909880958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:45:09Z,user_data=None,user_id='ca7c6c355f6045b3b372b280e0f45293',uuid=6cc61915-ab05-4f3c-80ff-b873ae3dc68a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Converting VIF {"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c7:4b,bridge_name='br-int',has_traffic_filtering=True,id=0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7e5f13-e7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG os_vif [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c7:4b,bridge_name='br-int',has_traffic_filtering=True,id=0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7e5f13-e7') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '961300ce-2d5a-5102-890c-6e390934b53d', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b7e5f13-e7, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b7e5f13-e7, col_values=(('qos', UUID('323a0ec1-092f-4cd9-be96-5b5e7119e9f5')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b7e5f13-e7, col_values=(('external_ids', {'iface-id': '0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:c7:4b', 'vm-uuid': '6cc61915-ab05-4f3c-80ff-b873ae3dc68a'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:11 user nova-compute[80928]: INFO os_vif [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c7:4b,bridge_name='br-int',has_traffic_filtering=True,id=0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7e5f13-e7')
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] No VIF found with MAC fa:16:3e:40:c7:4b, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.network.neutron [req-df5fc205-1b5c-4046-893b-5401784f64dc req-41c1c9e8-aa85-431c-a9b8-97daec037f00 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Updated VIF entry in instance network info cache for port 0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:45:11 user nova-compute[80928]: DEBUG nova.network.neutron [req-df5fc205-1b5c-4046-893b-5401784f64dc req-41c1c9e8-aa85-431c-a9b8-97daec037f00 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Updating instance_info_cache with network_info: [{"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:45:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-df5fc205-1b5c-4046-893b-5401784f64dc req-41c1c9e8-aa85-431c-a9b8-97daec037f00 service nova] Releasing lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:45:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-aa40a732-589d-4f2a-b74a-957306e84569 req-65ef4cee-258a-4799-af7e-c3543b22407c service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Received event network-vif-plugged-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa40a732-589d-4f2a-b74a-957306e84569 req-65ef4cee-258a-4799-af7e-c3543b22407c service nova] Acquiring lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa40a732-589d-4f2a-b74a-957306e84569 req-65ef4cee-258a-4799-af7e-c3543b22407c service nova] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa40a732-589d-4f2a-b74a-957306e84569 req-65ef4cee-258a-4799-af7e-c3543b22407c service nova] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-aa40a732-589d-4f2a-b74a-957306e84569 req-65ef4cee-258a-4799-af7e-c3543b22407c service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] No waiting events found dispatching network-vif-plugged-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:45:15 user nova-compute[80928]: WARNING nova.compute.manager [req-aa40a732-589d-4f2a-b74a-957306e84569 req-65ef4cee-258a-4799-af7e-c3543b22407c service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Received unexpected event network-vif-plugged-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c for instance with vm_state building and task_state spawning.
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-7dd9ad71-caa9-41b6-91d9-208c6f2de117 req-269055c7-32ba-448f-812f-7f998f176151 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Received event network-vif-plugged-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7dd9ad71-caa9-41b6-91d9-208c6f2de117 req-269055c7-32ba-448f-812f-7f998f176151 service nova] Acquiring lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7dd9ad71-caa9-41b6-91d9-208c6f2de117 req-269055c7-32ba-448f-812f-7f998f176151 service nova] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7dd9ad71-caa9-41b6-91d9-208c6f2de117 req-269055c7-32ba-448f-812f-7f998f176151 service nova] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-7dd9ad71-caa9-41b6-91d9-208c6f2de117 req-269055c7-32ba-448f-812f-7f998f176151 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] No waiting events found dispatching network-vif-plugged-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:45:15 user nova-compute[80928]: WARNING nova.compute.manager [req-7dd9ad71-caa9-41b6-91d9-208c6f2de117 req-269055c7-32ba-448f-812f-7f998f176151 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Received unexpected event network-vif-plugged-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c for instance with vm_state building and task_state spawning.
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:45:15 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Instance spawned successfully.
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:45:15 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:45:15 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7490MB free_disk=25.104736328125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:45:15 user nova-compute[80928]: INFO nova.compute.manager [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Took 6.43 seconds to spawn the instance on the hypervisor.
Nov 16 05:45:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:45:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 310c7fc9-af32-42dd-be30-8460daa03279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 0a2fc694-8d82-4f4b-971d-18454c975fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 765e9a3f-b188-483c-b149-2df53766fed8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 48435326-337f-4a1f-b213-d6726dc8d874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance d06f80f3-1989-4d33-bc1e-d9674292e0de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:45:16 user nova-compute[80928]: INFO nova.compute.manager [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Took 7.42 seconds to build instance.
Nov 16 05:45:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3e516ca4-53aa-484d-9c3f-e2349c6b7230 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.553s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:17 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:17 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:45:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:24 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 05:45:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] There are 0 instances to clean {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 05:45:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-d3b1498e-3adc-4627-a8a6-e1b7dd820f93 req-189d4d46-a55d-4a2f-885e-b7bfe11da568 service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Received event network-changed-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:45:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-d3b1498e-3adc-4627-a8a6-e1b7dd820f93 req-189d4d46-a55d-4a2f-885e-b7bfe11da568 service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Refreshing instance network info cache due to event network-changed-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:45:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d3b1498e-3adc-4627-a8a6-e1b7dd820f93 req-189d4d46-a55d-4a2f-885e-b7bfe11da568 service nova] Acquiring lock "refresh_cache-22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:45:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d3b1498e-3adc-4627-a8a6-e1b7dd820f93 req-189d4d46-a55d-4a2f-885e-b7bfe11da568 service nova] Acquired lock "refresh_cache-22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:45:48 user nova-compute[80928]: DEBUG nova.network.neutron [req-d3b1498e-3adc-4627-a8a6-e1b7dd820f93 req-189d4d46-a55d-4a2f-885e-b7bfe11da568 service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Refreshing network info cache for port 4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:45:48 user nova-compute[80928]: DEBUG nova.network.neutron [req-d3b1498e-3adc-4627-a8a6-e1b7dd820f93 req-189d4d46-a55d-4a2f-885e-b7bfe11da568 service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Updated VIF entry in instance network info cache for port 4f77cc7a-2a19-4f3c-bbd4-d74d36912c91. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:45:48 user nova-compute[80928]: DEBUG nova.network.neutron [req-d3b1498e-3adc-4627-a8a6-e1b7dd820f93 req-189d4d46-a55d-4a2f-885e-b7bfe11da568 service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Updating instance_info_cache with network_info: [{"id": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "address": "fa:16:3e:fa:d8:93", "network": {"id": "7de5f7dc-2d57-44b1-abd9-e135d7a3428b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-448110210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64c114702dc14f2d8462f313ea4999af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f77cc7a-2a", "ovs_interfaceid": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:45:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d3b1498e-3adc-4627-a8a6-e1b7dd820f93 req-189d4d46-a55d-4a2f-885e-b7bfe11da568 service nova] Releasing lock "refresh_cache-22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:45:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:45:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:49 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:45:49 user nova-compute[80928]: INFO nova.compute.claims [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Claim successful on node user
Nov 16 05:45:50 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:45:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:45:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG nova.policy [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ade947942acc48ef940224970f670985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8820092d2a4d50ab092ac90e5e1d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:45:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Creating image(s)
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "/opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "/opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "/opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.171s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk 1073741824" returned: 0 in 0.048s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Successfully created port: d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Cannot resize image /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Ensure instance console log exists: /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Successfully updated port: d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquired lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG nova.compute.manager [req-03466256-0aa8-4349-ad08-8a4412178e1b req-a23e0d53-cfc8-4bf2-940e-8e9c6fce7751 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-changed-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG nova.compute.manager [req-03466256-0aa8-4349-ad08-8a4412178e1b req-a23e0d53-cfc8-4bf2-940e-8e9c6fce7751 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Refreshing instance network info cache due to event network-changed-d5c7e129-4809-463e-b3c9-5091f165e8c5. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-03466256-0aa8-4349-ad08-8a4412178e1b req-a23e0d53-cfc8-4bf2-940e-8e9c6fce7751 service nova] Acquiring lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG nova.objects.instance [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'flavor' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:45:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:52 user nova-compute[80928]: INFO nova.compute.manager [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attaching volume cfe287ba-c6a4-4048-be64-544b9b0aa670 to /dev/vdb
Nov 16 05:45:52 user nova-compute[80928]: DEBUG os_brick.utils [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca65472-33bb-43a4-8eca-abdac3acfd8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdad5e65-30d7-43e5-92c8-12d9c2c67950]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.network.neutron [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updating instance_info_cache with network_info: [{"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Releasing lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Instance network_info: |[{"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3176761d-aac7-4abe-915e-44d85dd98836]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-03466256-0aa8-4349-ad08-8a4412178e1b req-a23e0d53-cfc8-4bf2-940e-8e9c6fce7751 service nova] Acquired lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.network.neutron [req-03466256-0aa8-4349-ad08-8a4412178e1b req-a23e0d53-cfc8-4bf2-940e-8e9c6fce7751 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Refreshing network info cache for port d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Start _get_guest_xml network_info=[{"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb94f4e5-39f7-4e74-8b6f-54f4c5cb9167]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:45:52 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58e651e-2220-4540-932c-dc4f63933826]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG os_brick.utils [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Updating existing volume attachment record: d53c2990-319c-467b-9c6b-5f8f3fbb08dd {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:45:52 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:45:52 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-862455296',display_name='tempest-ServerRescueNegativeTestJSON-server-862455296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-862455296',id=35,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkw5iCaKuOS7IO2Sp9Heoc9mgZtHIGvE/j7xHdnGD10/NqBa38q9r3At6EKN4fK/8sUZl11uX5NLPj1Y3OV/R6Md0dVYQok4USN7TvyvaboDEqgtO3EVj0eWlt2HqmVCg==',key_name='tempest-keypair-984127359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8820092d2a4d50ab092ac90e5e1d3d',ramdisk_id='',reservation_id='r-9c1an6p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-575506684',owner_user_name='tempest-ServerRescueNegativeTestJSON-575506684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ade947942acc48ef940224970f670985',uuid=f38bf2ae-3719-400f-9da0-dcfade8c6fd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converting VIF {"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:65:29,bridge_name='br-int',has_traffic_filtering=True,id=d5c7e129-4809-463e-b3c9-5091f165e8c5,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c7e129-48') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.objects.instance [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'pci_devices' on Instance uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:45:52 user nova-compute[80928]:   <uuid>f38bf2ae-3719-400f-9da0-dcfade8c6fd7</uuid>
Nov 16 05:45:52 user nova-compute[80928]:   <name>instance-00000023</name>
Nov 16 05:45:52 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:45:52 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:45:52 user nova-compute[80928]:   <metadata>
Nov 16 05:45:52 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:45:52 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:45:52 user nova-compute[80928]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-862455296</nova:name>
Nov 16 05:45:52 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:45:52</nova:creationTime>
Nov 16 05:45:52 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:45:52 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:45:52 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:45:52 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:45:52 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:45:52 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:45:52 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:45:52 user nova-compute[80928]:       <nova:owner>
Nov 16 05:45:52 user nova-compute[80928]:         <nova:user uuid="ade947942acc48ef940224970f670985">tempest-ServerRescueNegativeTestJSON-575506684-project-member</nova:user>
Nov 16 05:45:52 user nova-compute[80928]:         <nova:project uuid="bf8820092d2a4d50ab092ac90e5e1d3d">tempest-ServerRescueNegativeTestJSON-575506684</nova:project>
Nov 16 05:45:52 user nova-compute[80928]:       </nova:owner>
Nov 16 05:45:52 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:45:52 user nova-compute[80928]:       <nova:ports>
Nov 16 05:45:52 user nova-compute[80928]:         <nova:port uuid="d5c7e129-4809-463e-b3c9-5091f165e8c5">
Nov 16 05:45:52 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 05:45:52 user nova-compute[80928]:         </nova:port>
Nov 16 05:45:52 user nova-compute[80928]:       </nova:ports>
Nov 16 05:45:52 user nova-compute[80928]:     </nova:instance>
Nov 16 05:45:52 user nova-compute[80928]:   </metadata>
Nov 16 05:45:52 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:45:52 user nova-compute[80928]:     <system>
Nov 16 05:45:52 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:45:52 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:45:52 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:45:52 user nova-compute[80928]:       <entry name="serial">f38bf2ae-3719-400f-9da0-dcfade8c6fd7</entry>
Nov 16 05:45:52 user nova-compute[80928]:       <entry name="uuid">f38bf2ae-3719-400f-9da0-dcfade8c6fd7</entry>
Nov 16 05:45:52 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:45:52 user nova-compute[80928]:     </system>
Nov 16 05:45:52 user nova-compute[80928]:   </sysinfo>
Nov 16 05:45:52 user nova-compute[80928]:   <os>
Nov 16 05:45:52 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:45:52 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:45:52 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:45:52 user nova-compute[80928]:   </os>
Nov 16 05:45:52 user nova-compute[80928]:   <features>
Nov 16 05:45:52 user nova-compute[80928]:     <acpi/>
Nov 16 05:45:52 user nova-compute[80928]:     <apic/>
Nov 16 05:45:52 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:45:52 user nova-compute[80928]:   </features>
Nov 16 05:45:52 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:45:52 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:45:52 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:45:52 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:45:52 user nova-compute[80928]:   </clock>
Nov 16 05:45:52 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:45:52 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:45:52 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:45:52 user nova-compute[80928]:   </cpu>
Nov 16 05:45:52 user nova-compute[80928]:   <devices>
Nov 16 05:45:52 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:45:52 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:45:52 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk"/>
Nov 16 05:45:52 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:45:52 user nova-compute[80928]:     </disk>
Nov 16 05:45:52 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:45:52 user nova-compute[80928]:       <mac address="fa:16:3e:b2:65:29"/>
Nov 16 05:45:52 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:45:52 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:45:52 user nova-compute[80928]:       <target dev="tapd5c7e129-48"/>
Nov 16 05:45:52 user nova-compute[80928]:     </interface>
Nov 16 05:45:52 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:45:52 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/console.log" append="off"/>
Nov 16 05:45:52 user nova-compute[80928]:     </serial>
Nov 16 05:45:52 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:45:52 user nova-compute[80928]:     <video>
Nov 16 05:45:52 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:45:52 user nova-compute[80928]:     </video>
Nov 16 05:45:52 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:45:52 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:45:52 user nova-compute[80928]:     </rng>
Nov 16 05:45:52 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:45:52 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:45:52 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:45:52 user nova-compute[80928]:     </memballoon>
Nov 16 05:45:52 user nova-compute[80928]:   </devices>
Nov 16 05:45:52 user nova-compute[80928]: </domain>
Nov 16 05:45:52 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-862455296',display_name='tempest-ServerRescueNegativeTestJSON-server-862455296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-862455296',id=35,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkw5iCaKuOS7IO2Sp9Heoc9mgZtHIGvE/j7xHdnGD10/NqBa38q9r3At6EKN4fK/8sUZl11uX5NLPj1Y3OV/R6Md0dVYQok4USN7TvyvaboDEqgtO3EVj0eWlt2HqmVCg==',key_name='tempest-keypair-984127359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8820092d2a4d50ab092ac90e5e1d3d',ramdisk_id='',reservation_id='r-9c1an6p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-575506684',owner_user_name='tempest-ServerRescueNegativeTestJSON-575506684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ade947942acc48ef940224970f670985',uuid=f38bf2ae-3719-400f-9da0-dcfade8c6fd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converting VIF {"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:65:29,bridge_name='br-int',has_traffic_filtering=True,id=d5c7e129-4809-463e-b3c9-5091f165e8c5,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c7e129-48') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG os_vif [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:65:29,bridge_name='br-int',has_traffic_filtering=True,id=d5c7e129-4809-463e-b3c9-5091f165e8c5,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c7e129-48') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cadb794-018e-5cc7-8cb7-2fce6e569274', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5c7e129-48, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5c7e129-48, col_values=(('qos', UUID('78054c49-3cc7-40fe-b0d1-644ade483b7e')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5c7e129-48, col_values=(('external_ids', {'iface-id': 'd5c7e129-4809-463e-b3c9-5091f165e8c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:65:29', 'vm-uuid': 'f38bf2ae-3719-400f-9da0-dcfade8c6fd7'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:52 user nova-compute[80928]: INFO os_vif [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:65:29,bridge_name='br-int',has_traffic_filtering=True,id=d5c7e129-4809-463e-b3c9-5091f165e8c5,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c7e129-48')
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No VIF found with MAC fa:16:3e:b2:65:29, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.network.neutron [req-03466256-0aa8-4349-ad08-8a4412178e1b req-a23e0d53-cfc8-4bf2-940e-8e9c6fce7751 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updated VIF entry in instance network info cache for port d5c7e129-4809-463e-b3c9-5091f165e8c5. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG nova.network.neutron [req-03466256-0aa8-4349-ad08-8a4412178e1b req-a23e0d53-cfc8-4bf2-940e-8e9c6fce7751 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updating instance_info_cache with network_info: [{"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:45:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-03466256-0aa8-4349-ad08-8a4412178e1b req-a23e0d53-cfc8-4bf2-940e-8e9c6fce7751 service nova] Releasing lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:45:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-4784ae30-4fc9-4dd4-9b5b-08e4ee3d0539 req-4908cd99-d43c-409e-bdd7-11408ad30f21 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:45:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4784ae30-4fc9-4dd4-9b5b-08e4ee3d0539 req-4908cd99-d43c-409e-bdd7-11408ad30f21 service nova] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4784ae30-4fc9-4dd4-9b5b-08e4ee3d0539 req-4908cd99-d43c-409e-bdd7-11408ad30f21 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4784ae30-4fc9-4dd4-9b5b-08e4ee3d0539 req-4908cd99-d43c-409e-bdd7-11408ad30f21 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-4784ae30-4fc9-4dd4-9b5b-08e4ee3d0539 req-4908cd99-d43c-409e-bdd7-11408ad30f21 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] No waiting events found dispatching network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:45:53 user nova-compute[80928]: WARNING nova.compute.manager [req-4784ae30-4fc9-4dd4-9b5b-08e4ee3d0539 req-4908cd99-d43c-409e-bdd7-11408ad30f21 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received unexpected event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 for instance with vm_state building and task_state spawning.
Nov 16 05:45:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_power_states {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 8292134f-09d4-4240-94bb-281e6c236d09 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 762caa99-5c4a-428d-8059-7903d0bdb149 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid a39e1ed9-2651-4de2-8979-c030b02b0ee1 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 4a171080-2c54-4092-902d-7a3f815656b9 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 310c7fc9-af32-42dd-be30-8460daa03279 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 48435326-337f-4a1f-b213-d6726dc8d874 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 765e9a3f-b188-483c-b149-2df53766fed8 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 0a2fc694-8d82-4f4b-971d-18454c975fcd {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid d06f80f3-1989-4d33-bc1e-d9674292e0de {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 6cc61915-ab05-4f3c-80ff-b873ae3dc68a {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "8292134f-09d4-4240-94bb-281e6c236d09" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "8292134f-09d4-4240-94bb-281e6c236d09" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "762caa99-5c4a-428d-8059-7903d0bdb149" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "762caa99-5c4a-428d-8059-7903d0bdb149" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "4a171080-2c54-4092-902d-7a3f815656b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "310c7fc9-af32-42dd-be30-8460daa03279" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "310c7fc9-af32-42dd-be30-8460daa03279" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "48435326-337f-4a1f-b213-d6726dc8d874" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "765e9a3f-b188-483c-b149-2df53766fed8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "d06f80f3-1989-4d33-bc1e-d9674292e0de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "762caa99-5c4a-428d-8059-7903d0bdb149" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "8292134f-09d4-4240-94bb-281e6c236d09" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "765e9a3f-b188-483c-b149-2df53766fed8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "310c7fc9-af32-42dd-be30-8460daa03279" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "4a171080-2c54-4092-902d-7a3f815656b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "48435326-337f-4a1f-b213-d6726dc8d874" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "48435326-337f-4a1f-b213-d6726dc8d874" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:55 user nova-compute[80928]: INFO nova.compute.manager [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Terminating instance
Nov 16 05:45:55 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:45:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:45:55 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Instance spawned successfully.
Nov 16 05:45:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-b33ddc17-2c3c-482f-a95b-500a653796d3 req-6b984c42-b132-4857-af50-b6259cb0bb33 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b33ddc17-2c3c-482f-a95b-500a653796d3 req-6b984c42-b132-4857-af50-b6259cb0bb33 service nova] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b33ddc17-2c3c-482f-a95b-500a653796d3 req-6b984c42-b132-4857-af50-b6259cb0bb33 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b33ddc17-2c3c-482f-a95b-500a653796d3 req-6b984c42-b132-4857-af50-b6259cb0bb33 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-b33ddc17-2c3c-482f-a95b-500a653796d3 req-6b984c42-b132-4857-af50-b6259cb0bb33 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] No waiting events found dispatching network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:45:56 user nova-compute[80928]: WARNING nova.compute.manager [req-b33ddc17-2c3c-482f-a95b-500a653796d3 req-6b984c42-b132-4857-af50-b6259cb0bb33 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received unexpected event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 for instance with vm_state building and task_state spawning.
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-b33ddc17-2c3c-482f-a95b-500a653796d3 req-6b984c42-b132-4857-af50-b6259cb0bb33 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-unplugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b33ddc17-2c3c-482f-a95b-500a653796d3 req-6b984c42-b132-4857-af50-b6259cb0bb33 service nova] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b33ddc17-2c3c-482f-a95b-500a653796d3 req-6b984c42-b132-4857-af50-b6259cb0bb33 service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b33ddc17-2c3c-482f-a95b-500a653796d3 req-6b984c42-b132-4857-af50-b6259cb0bb33 service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-b33ddc17-2c3c-482f-a95b-500a653796d3 req-6b984c42-b132-4857-af50-b6259cb0bb33 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] No waiting events found dispatching network-vif-unplugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.compute.manager [req-b33ddc17-2c3c-482f-a95b-500a653796d3 req-6b984c42-b132-4857-af50-b6259cb0bb33 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-unplugged-23245452-d757-4f54-bd1f-ad857f7c25da for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:45:56 user nova-compute[80928]: INFO nova.compute.manager [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Instance destroyed successfully.
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lazy-loading 'resources' on Instance uuid 48435326-337f-4a1f-b213-d6726dc8d874 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:45:56 user nova-compute[80928]: INFO nova.compute.manager [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Took 6.30 seconds to build instance.
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T05:40:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1026899600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1026899600',id=29,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTEsmWvmLnfwWRPHYSw37ebtNtMfKhffLuK4BthyMPgtFmpE97cB9GkBpRVp9gKJTB9uQrQ2oEV9S4BczHv6aMH5QssZrVCQr46XuQS7IOBv81XuBHbCLVnXQmb+RQ0Hg==',key_name='tempest-keypair-851703054',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9efdd13a65f44182a910ecf45bf27116',ramdisk_id='',reservation_id='r-c0ou62pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-658694431',owner_user_name='tempest-AttachVolumeShelveTestJSON-658694431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='505358920a9e43c59cf29b85ffbccb95',uuid=48435326-337f-4a1f-b213-d6726dc8d874,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converting VIF {"id": "23245452-d757-4f54-bd1f-ad857f7c25da", "address": "fa:16:3e:4e:5d:e2", "network": {"id": "5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-224775768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9efdd13a65f44182a910ecf45bf27116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23245452-d7", "ovs_interfaceid": "23245452-d757-4f54-bd1f-ad857f7c25da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG os_vif [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23245452-d7, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6bd7330-82d8-4d2c-b8d5-00f83df48436 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.412s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.202s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:56 user nova-compute[80928]: INFO nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 16 05:45:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=922168b4-c994-418f-9e1a-09c22c97b49d) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:45:56 user nova-compute[80928]: INFO os_vif [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=23245452-d757-4f54-bd1f-ad857f7c25da,network=Network(5d2539cb-48b7-4e4d-ab5d-0cb57e182d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23245452-d7')
Nov 16 05:45:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Deleting instance files /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874_del
Nov 16 05:45:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Deletion of /opt/stack/data/nova/instances/48435326-337f-4a1f-b213-d6726dc8d874_del complete
Nov 16 05:45:56 user nova-compute[80928]: INFO nova.compute.manager [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 16 05:45:56 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:45:56 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:45:57 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Took 0.72 seconds to deallocate network for instance.
Nov 16 05:45:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-df74f912-b6d2-4774-a063-d1b50912c7ea req-33d3d4b1-450f-4c3e-811c-f542a18cb508 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-deleted-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUIydKZF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:45:57 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:45:57 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:45:57 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8416a3db-5e71-4049-8fc5-8d6d5e8f2bf9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:45:57 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a592cb1f-20b2-4294-a51d-d0b1b74fed48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670] added
Nov 16 05:45:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[602ef11c-d27b-4b02-9527-e91326b3b960]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[860803eb-e40a-469e-9efa-55022702d962]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUIydKZF {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUIydKZF" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[734dce86-3c16-4eee-ab41-b03270b36b1d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUIydKZF'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[00008d0a-8ef0-41c7-9495-ef0cb990bbe6]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c73887e-6c03-42ca-ba2f-335d33bd7f40]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:45:57 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:45:57 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:45:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:45:57 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:45:57 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:45:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:45:57 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Deleted allocations for instance 48435326-337f-4a1f-b213-d6726dc8d874
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6768026a-c8ba-4de1-a7df-6dacd6d74a81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670, portal: 172.16.0.220,3260]
Nov 16 05:45:57 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670, portal: 172.16.0.220,3260] successful.
Nov 16 05:45:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf198c68-d0a9-490c-826b-39ee1f4329b7]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ec1135b1-a21b-40fc-a022-0629d92b50b9 tempest-AttachVolumeShelveTestJSON-658694431 tempest-AttachVolumeShelveTestJSON-658694431-project-member] Lock "48435326-337f-4a1f-b213-d6726dc8d874" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.038s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[120d9e47-e1ba-4a4c-a897-00d7e9eac640]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:45:57 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:45:57 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:45:57 user nova-compute[80928]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 (non-flash)
Nov 16 05:45:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:45:57 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:45:57 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:45:57 user nova-compute[80928]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 (non-flash)
Nov 16 05:45:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7623c4-3e1f-4106-bc0f-db3a66855442]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:45:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUIydKZF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:45:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-cbe71213-8dd3-4dce-961f-9454d371560d req-927136f0-913e-48ac-b548-1f88a40ecd21 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:45:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cbe71213-8dd3-4dce-961f-9454d371560d req-927136f0-913e-48ac-b548-1f88a40ecd21 service nova] Acquiring lock "48435326-337f-4a1f-b213-d6726dc8d874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:45:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cbe71213-8dd3-4dce-961f-9454d371560d req-927136f0-913e-48ac-b548-1f88a40ecd21 service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cbe71213-8dd3-4dce-961f-9454d371560d req-927136f0-913e-48ac-b548-1f88a40ecd21 service nova] Lock "48435326-337f-4a1f-b213-d6726dc8d874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-cbe71213-8dd3-4dce-961f-9454d371560d req-927136f0-913e-48ac-b548-1f88a40ecd21 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] No waiting events found dispatching network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:45:58 user nova-compute[80928]: WARNING nova.compute.manager [req-cbe71213-8dd3-4dce-961f-9454d371560d req-927136f0-913e-48ac-b548-1f88a40ecd21 service nova] [instance: 48435326-337f-4a1f-b213-d6726dc8d874] Received unexpected event network-vif-plugged-23245452-d757-4f54-bd1f-ad857f7c25da for instance with vm_state deleted and task_state None.
Nov 16 05:45:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:45:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23530353435303939', 'path': '/dev/sdd'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:45:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530353435303939', 'path': '/dev/sdd'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:45:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'flavor' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:45:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:45:58 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:45:58 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:45:58 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:45:58 user nova-compute[80928]:   <serial>cfe287ba-c6a4-4048-be64-544b9b0aa670</serial>
Nov 16 05:45:58 user nova-compute[80928]: </disk>
Nov 16 05:45:58 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:45:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:45:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:45:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No VIF found with MAC fa:16:3e:fa:d8:93, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:45:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-72ff8eed-5a51-4f1b-a80f-fde6b47e6758 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.185s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:45:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.280s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:45:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:46:03 user nova-compute[80928]: INFO nova.compute.manager [None req-6558e3a6-849e-4057-a857-25b1f6cc187a tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Get console output
Nov 16 05:46:03 user nova-compute[80928]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:06 user nova-compute[80928]: INFO nova.compute.manager [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Terminating instance
Nov 16 05:46:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-f6417dd7-43a8-4660-8a1a-e7fbbab548e6 req-f6d40b2e-408c-458a-a543-ad658e70f527 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-unplugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f6417dd7-43a8-4660-8a1a-e7fbbab548e6 req-f6d40b2e-408c-458a-a543-ad658e70f527 service nova] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f6417dd7-43a8-4660-8a1a-e7fbbab548e6 req-f6d40b2e-408c-458a-a543-ad658e70f527 service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f6417dd7-43a8-4660-8a1a-e7fbbab548e6 req-f6d40b2e-408c-458a-a543-ad658e70f527 service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-f6417dd7-43a8-4660-8a1a-e7fbbab548e6 req-f6d40b2e-408c-458a-a543-ad658e70f527 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] No waiting events found dispatching network-vif-unplugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-f6417dd7-43a8-4660-8a1a-e7fbbab548e6 req-f6d40b2e-408c-458a-a543-ad658e70f527 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-unplugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:46:06 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Instance destroyed successfully.
Nov 16 05:46:06 user nova-compute[80928]: DEBUG nova.objects.instance [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'resources' on Instance uuid 0a2fc694-8d82-4f4b-971d-18454c975fcd {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1390268242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1390268242',id=31,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:42:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-en9b6r0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:44:23Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=0a2fc694-8d82-4f4b-971d-18454c975fcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "address": "fa:16:3e:57:91:f4", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db814a1-9a", "ovs_interfaceid": "1db814a1-9a0c-47e2-9e29-5e7616a8156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:91:f4,bridge_name='br-int',has_traffic_filtering=True,id=1db814a1-9a0c-47e2-9e29-5e7616a8156c,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db814a1-9a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG os_vif [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:91:f4,bridge_name='br-int',has_traffic_filtering=True,id=1db814a1-9a0c-47e2-9e29-5e7616a8156c,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db814a1-9a') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1db814a1-9a, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10188fa6-80a3-4666-b5a8-e5d1108ff7d8) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:06 user nova-compute[80928]: INFO os_vif [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:91:f4,bridge_name='br-int',has_traffic_filtering=True,id=1db814a1-9a0c-47e2-9e29-5e7616a8156c,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db814a1-9a')
Nov 16 05:46:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDciazuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:46:06 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:46:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d444370f-cbb1-472d-b12e-1239175a3fa3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:46:06 user nova-compute[80928]: No targets found.
Nov 16 05:46:06 user nova-compute[80928]: iSNS:
Nov 16 05:46:06 user nova-compute[80928]: No targets found.
Nov 16 05:46:06 user nova-compute[80928]: STATIC:
Nov 16 05:46:06 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d
Nov 16 05:46:06 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:46:06 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:46:06 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670
Nov 16 05:46:06 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:46:06 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:46:06 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:46:06 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:46:06 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:46:06 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d
Nov 16 05:46:06 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:46:06 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:46:06 user nova-compute[80928]: FIRMWARE:
Nov 16 05:46:06 user nova-compute[80928]: No targets found.
Nov 16 05:46:06 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:46:07 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:46:07 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7d526e-6ba0-4565-afc2-c8d9e7ed0e56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5ff79d-21d9-4d0c-b5fb-b608b7b5b747]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:46:07 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:46:07 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:46:07 user nova-compute[80928]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 (non-flash)
Nov 16 05:46:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:46:07 user nova-compute[80928]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d (non-flash)
Nov 16 05:46:07 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:46:07 user nova-compute[80928]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 (non-flash)
Nov 16 05:46:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8658545e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d'): ({'sdf'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Removing single pathed devices sdf {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[be60c47f-694d-4077-b5c3-64fea0c3822e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd8184-02ed-414f-8bfd-06c05ac1bae4]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flushing IO for device /dev/sdf {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7ac168-2553-4df1-a110-ee8227ac9013]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb9b396-9afb-401f-a970-115daab514c4]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] SCSI volumes sdf have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4570f56', '/dev/disk/by-id/scsi-1SCST_BIO4570f56-5e356a372db5b02b', '/dev/disk/by-id/scsi-23565333536613337') {{(pid=92262) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb4f8c6-5db4-4c4a-9bbe-b14f8693866e]: (4, None) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eee13d-6c57-4c97-9cfa-e71b71d470b6]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9d329d-705e-4412-93a0-99c2ffdd8cc3]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d, portal: 172.16.0.220,3260]
Nov 16 05:46:07 user nova-compute[80928]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d, portal: 172.16.0.220,3260] successful.
Nov 16 05:46:07 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18b5e9d1-d53f-4270-9e0f-af1302953f1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfd40e2-d451-4308-b46d-b980fd5bdb33]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] <== disconnect_volume: return (334ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:46:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Deleting instance files /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd_del
Nov 16 05:46:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Deletion of /opt/stack/data/nova/instances/0a2fc694-8d82-4f4b-971d-18454c975fcd_del complete
Nov 16 05:46:07 user nova-compute[80928]: INFO nova.compute.manager [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:46:07 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:46:07 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Took 0.51 seconds to deallocate network for instance.
Nov 16 05:46:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-877d6f7a-be45-4f5a-83c2-221e0e6ba4b2 req-e9e04221-2672-45ef-b3f3-2f1eb086a72d service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-deleted-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:46:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-aa8285e6-88dd-4fa4-a460-29e12ee322b9 req-adf34e16-1e51-45a2-92c0-be620cd6e354 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:46:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa8285e6-88dd-4fa4-a460-29e12ee322b9 req-adf34e16-1e51-45a2-92c0-be620cd6e354 service nova] Acquiring lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa8285e6-88dd-4fa4-a460-29e12ee322b9 req-adf34e16-1e51-45a2-92c0-be620cd6e354 service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aa8285e6-88dd-4fa4-a460-29e12ee322b9 req-adf34e16-1e51-45a2-92c0-be620cd6e354 service nova] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-aa8285e6-88dd-4fa4-a460-29e12ee322b9 req-adf34e16-1e51-45a2-92c0-be620cd6e354 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] No waiting events found dispatching network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:46:08 user nova-compute[80928]: WARNING nova.compute.manager [req-aa8285e6-88dd-4fa4-a460-29e12ee322b9 req-adf34e16-1e51-45a2-92c0-be620cd6e354 service nova] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Received unexpected event network-vif-plugged-1db814a1-9a0c-47e2-9e29-5e7616a8156c for instance with vm_state active and task_state deleting.
Nov 16 05:46:08 user nova-compute[80928]: INFO nova.compute.manager [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 0a2fc694-8d82-4f4b-971d-18454c975fcd] Took 0.84 seconds to detach 1 volumes for instance.
Nov 16 05:46:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:09 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:46:09 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:46:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:09 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Deleted allocations for instance 0a2fc694-8d82-4f4b-971d-18454c975fcd
Nov 16 05:46:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5f4c0be3-7755-4e5a-a434-2c13962995b8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "0a2fc694-8d82-4f4b-971d-18454c975fcd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.135s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:09 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:46:09 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:46:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:46:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:46:09 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:10 user nova-compute[80928]: INFO nova.compute.manager [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Detaching volume cfe287ba-c6a4-4048-be64-544b9b0aa670
Nov 16 05:46:10 user nova-compute[80928]: INFO nova.virt.block_device [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attempting to driver detach volume cfe287ba-c6a4-4048-be64-544b9b0aa670 from mountpoint /dev/vdb
Nov 16 05:46:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Attempting to detach device vdb from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:46:10 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:46:10 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:46:10 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:46:10 user nova-compute[80928]:   <serial>cfe287ba-c6a4-4048-be64-544b9b0aa670</serial>
Nov 16 05:46:10 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:46:10 user nova-compute[80928]: </disk>
Nov 16 05:46:10 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:46:10 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Successfully detached device vdb from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the persistent domain config.
Nov 16 05:46:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:46:10 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:46:10 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:46:10 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:46:10 user nova-compute[80928]:   <serial>cfe287ba-c6a4-4048-be64-544b9b0aa670</serial>
Nov 16 05:46:10 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:46:10 user nova-compute[80928]: </disk>
Nov 16 05:46:10 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Updating instance_info_cache with network_info: [{"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:10 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Acquiring lock "d06f80f3-1989-4d33-bc1e-d9674292e0de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Acquiring lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:13 user nova-compute[80928]: INFO nova.compute.manager [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Terminating instance
Nov 16 05:46:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-453e97bd-0b55-44ef-bb36-96cbb4d3c731 req-35a4e149-8840-402c-ba57-ee6a657b6d5b service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Received event network-vif-unplugged-926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-453e97bd-0b55-44ef-bb36-96cbb4d3c731 req-35a4e149-8840-402c-ba57-ee6a657b6d5b service nova] Acquiring lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-453e97bd-0b55-44ef-bb36-96cbb4d3c731 req-35a4e149-8840-402c-ba57-ee6a657b6d5b service nova] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-453e97bd-0b55-44ef-bb36-96cbb4d3c731 req-35a4e149-8840-402c-ba57-ee6a657b6d5b service nova] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-453e97bd-0b55-44ef-bb36-96cbb4d3c731 req-35a4e149-8840-402c-ba57-ee6a657b6d5b service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] No waiting events found dispatching network-vif-unplugged-926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-453e97bd-0b55-44ef-bb36-96cbb4d3c731 req-35a4e149-8840-402c-ba57-ee6a657b6d5b service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Received event network-vif-unplugged-926957a7-9fae-4eb3-947e-88e4a11abbb7 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Instance destroyed successfully.
Nov 16 05:46:14 user nova-compute[80928]: DEBUG nova.objects.instance [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lazy-loading 'resources' on Instance uuid d06f80f3-1989-4d33-bc1e-d9674292e0de {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2004734221',display_name='tempest-VolumesActionsTest-instance-2004734221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2004734221',id=33,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:44:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5c1a9b85bf24c9e99b230ce10c6c2fb',ramdisk_id='',reservation_id='r-751z88nj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1976056621',owner_user_name='tempest-VolumesActionsTest-1976056621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:44:25Z,user_data=None,user_id='31f326ea3728485f9b277a5643a2d1e1',uuid=d06f80f3-1989-4d33-bc1e-d9674292e0de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "address": "fa:16:3e:a0:6f:74", "network": {"id": "59f6784a-8503-45d2-8983-7db030135e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495559584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a9b85bf24c9e99b230ce10c6c2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926957a7-9f", "ovs_interfaceid": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Converting VIF {"id": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "address": "fa:16:3e:a0:6f:74", "network": {"id": "59f6784a-8503-45d2-8983-7db030135e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495559584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a9b85bf24c9e99b230ce10c6c2fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap926957a7-9f", "ovs_interfaceid": "926957a7-9fae-4eb3-947e-88e4a11abbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:74,bridge_name='br-int',has_traffic_filtering=True,id=926957a7-9fae-4eb3-947e-88e4a11abbb7,network=Network(59f6784a-8503-45d2-8983-7db030135e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926957a7-9f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG os_vif [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:74,bridge_name='br-int',has_traffic_filtering=True,id=926957a7-9fae-4eb3-947e-88e4a11abbb7,network=Network(59f6784a-8503-45d2-8983-7db030135e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926957a7-9f') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap926957a7-9f, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39acd932-3bba-4ac1-b990-c8bb62daa861) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:46:14 user nova-compute[80928]: INFO os_vif [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:74,bridge_name='br-int',has_traffic_filtering=True,id=926957a7-9fae-4eb3-947e-88e4a11abbb7,network=Network(59f6784a-8503-45d2-8983-7db030135e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap926957a7-9f')
Nov 16 05:46:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Deleting instance files /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de_del
Nov 16 05:46:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Deletion of /opt/stack/data/nova/instances/d06f80f3-1989-4d33-bc1e-d9674292e0de_del complete
Nov 16 05:46:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:14 user nova-compute[80928]: INFO nova.compute.manager [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 16 05:46:14 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-29163191-3610-4117-8201-7a82abc067f1 req-28a46b4f-1d86-4643-b7ad-e43d2dab98ff service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Received event network-vif-deleted-926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:46:14 user nova-compute[80928]: INFO nova.compute.manager [req-29163191-3610-4117-8201-7a82abc067f1 req-28a46b4f-1d86-4643-b7ad-e43d2dab98ff service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Neutron deleted interface 926957a7-9fae-4eb3-947e-88e4a11abbb7; detaching it from the instance and deleting it from the info cache
Nov 16 05:46:14 user nova-compute[80928]: DEBUG nova.network.neutron [req-29163191-3610-4117-8201-7a82abc067f1 req-28a46b4f-1d86-4643-b7ad-e43d2dab98ff service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:46:14 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Took 0.56 seconds to deallocate network for instance.
Nov 16 05:46:14 user nova-compute[80928]: DEBUG nova.compute.manager [req-29163191-3610-4117-8201-7a82abc067f1 req-28a46b4f-1d86-4643-b7ad-e43d2dab98ff service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Detach interface failed, port_id=926957a7-9fae-4eb3-947e-88e4a11abbb7, reason: Instance d06f80f3-1989-4d33-bc1e-d9674292e0de could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:15 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:46:15 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7646MB free_disk=25.06689453125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.741s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.257s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:15 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Deleted allocations for instance d06f80f3-1989-4d33-bc1e-d9674292e0de
Nov 16 05:46:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-63de9f70-cc7d-4985-9ca8-93c663876391 tempest-VolumesActionsTest-1976056621 tempest-VolumesActionsTest-1976056621-project-member] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.269s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 310c7fc9-af32-42dd-be30-8460daa03279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 765e9a3f-b188-483c-b149-2df53766fed8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-4cc98b49-76d1-4783-8c67-c83d5d7e60d6 req-00442be4-16e1-41e1-86b0-7b2ae8692bb3 service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Received event network-vif-plugged-926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4cc98b49-76d1-4783-8c67-c83d5d7e60d6 req-00442be4-16e1-41e1-86b0-7b2ae8692bb3 service nova] Acquiring lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4cc98b49-76d1-4783-8c67-c83d5d7e60d6 req-00442be4-16e1-41e1-86b0-7b2ae8692bb3 service nova] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4cc98b49-76d1-4783-8c67-c83d5d7e60d6 req-00442be4-16e1-41e1-86b0-7b2ae8692bb3 service nova] Lock "d06f80f3-1989-4d33-bc1e-d9674292e0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-4cc98b49-76d1-4783-8c67-c83d5d7e60d6 req-00442be4-16e1-41e1-86b0-7b2ae8692bb3 service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] No waiting events found dispatching network-vif-plugged-926957a7-9fae-4eb3-947e-88e4a11abbb7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:46:15 user nova-compute[80928]: WARNING nova.compute.manager [req-4cc98b49-76d1-4783-8c67-c83d5d7e60d6 req-00442be4-16e1-41e1-86b0-7b2ae8692bb3 service nova] [instance: d06f80f3-1989-4d33-bc1e-d9674292e0de] Received unexpected event network-vif-plugged-926957a7-9fae-4eb3-947e-88e4a11abbb7 for instance with vm_state deleted and task_state None.
Nov 16 05:46:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:16 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:46:16 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:46:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:46:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:19 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:46:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:46:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:30 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af is timed out.
Nov 16 05:46:30 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Successfully detached device vdb from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the live domain config.
Nov 16 05:46:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUIydKZF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:46:30 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b9a792-6b45-4e47-9e41-96cbf0313488]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:46:30 user nova-compute[80928]: No targets found.
Nov 16 05:46:30 user nova-compute[80928]: iSNS:
Nov 16 05:46:30 user nova-compute[80928]: No targets found.
Nov 16 05:46:30 user nova-compute[80928]: STATIC:
Nov 16 05:46:30 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670
Nov 16 05:46:30 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:46:30 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:46:30 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:46:30 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:46:30 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:46:30 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d
Nov 16 05:46:30 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:46:30 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:46:30 user nova-compute[80928]: FIRMWARE:
Nov 16 05:46:30 user nova-compute[80928]: No targets found.
Nov 16 05:46:30 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:46:30 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:46:30 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[823b9065-aa28-43cd-b830-757dfa7d4fd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f35af-6a96-4eaf-a0b9-2467f0ea5b91]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:46:30 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:46:30 user nova-compute[80928]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 (non-flash)
Nov 16 05:46:30 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:46:30 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:46:30 user nova-compute[80928]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 (non-flash)
Nov 16 05:46:30 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f865837f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670'): ({'sdd'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Removing single pathed devices sdd {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[167aa869-24ec-4c4a-9f6e-8dc1f3ab1e16]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a300ea79-13bc-4bc7-be24-5172b88ae089]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Flushing IO for device /dev/sdd {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c331b11-44e4-4817-b8f8-b1e4e4fedbc1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0a0d6e-8150-4253-aec8-f5822bd37321]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[923aee8d-058d-4c86-905e-c14a8211b5c3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d090d3-9926-431d-8481-000c99ef63eb]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670, portal: 172.16.0.220,3260]
Nov 16 05:46:30 user nova-compute[80928]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670, portal: 172.16.0.220,3260] successful.
Nov 16 05:46:30 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:46:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:46:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfe287ba-c6a4-4048-be64-544b9b0aa670 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:46:31 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[153d4d0e-2e4a-4e90-a621-6f6b6b578de4]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:46:31 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:46:31 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:46:31 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] <== disconnect_volume: return (317ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:46:31 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:46:31 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'flavor' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:46:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e674ebeb-23ea-48a3-ae11-d6f48d832584 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.736s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:46:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:46:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:46:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:46:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:46:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:46:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "310c7fc9-af32-42dd-be30-8460daa03279" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "310c7fc9-af32-42dd-be30-8460daa03279" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "310c7fc9-af32-42dd-be30-8460daa03279-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "310c7fc9-af32-42dd-be30-8460daa03279-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "310c7fc9-af32-42dd-be30-8460daa03279-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:57 user nova-compute[80928]: INFO nova.compute.manager [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Terminating instance
Nov 16 05:46:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-58f7c4e9-2319-4743-a967-85fd5a15dd21 req-dcc37973-dfdc-47b4-82c4-c5e492fc3ad1 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Received event network-vif-unplugged-73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-58f7c4e9-2319-4743-a967-85fd5a15dd21 req-dcc37973-dfdc-47b4-82c4-c5e492fc3ad1 service nova] Acquiring lock "310c7fc9-af32-42dd-be30-8460daa03279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-58f7c4e9-2319-4743-a967-85fd5a15dd21 req-dcc37973-dfdc-47b4-82c4-c5e492fc3ad1 service nova] Lock "310c7fc9-af32-42dd-be30-8460daa03279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-58f7c4e9-2319-4743-a967-85fd5a15dd21 req-dcc37973-dfdc-47b4-82c4-c5e492fc3ad1 service nova] Lock "310c7fc9-af32-42dd-be30-8460daa03279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-58f7c4e9-2319-4743-a967-85fd5a15dd21 req-dcc37973-dfdc-47b4-82c4-c5e492fc3ad1 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] No waiting events found dispatching network-vif-unplugged-73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-58f7c4e9-2319-4743-a967-85fd5a15dd21 req-dcc37973-dfdc-47b4-82c4-c5e492fc3ad1 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Received event network-vif-unplugged-73705bd3-4a7a-4430-b6bf-8b71adfac09b for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:57 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Instance destroyed successfully.
Nov 16 05:46:57 user nova-compute[80928]: DEBUG nova.objects.instance [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'resources' on Instance uuid 310c7fc9-af32-42dd-be30-8460daa03279 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-233322559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-233322559',id=27,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:37:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-ugngpnqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:39:31Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=310c7fc9-af32-42dd-be30-8460daa03279,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "address": "fa:16:3e:0a:4b:f7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73705bd3-4a", "ovs_interfaceid": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "address": "fa:16:3e:0a:4b:f7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73705bd3-4a", "ovs_interfaceid": "73705bd3-4a7a-4430-b6bf-8b71adfac09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4b:f7,bridge_name='br-int',has_traffic_filtering=True,id=73705bd3-4a7a-4430-b6bf-8b71adfac09b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73705bd3-4a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG os_vif [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4b:f7,bridge_name='br-int',has_traffic_filtering=True,id=73705bd3-4a7a-4430-b6bf-8b71adfac09b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73705bd3-4a') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73705bd3-4a, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=814c330d-0276-465c-a2ba-bac4067a9b8e) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:46:57 user nova-compute[80928]: INFO os_vif [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4b:f7,bridge_name='br-int',has_traffic_filtering=True,id=73705bd3-4a7a-4430-b6bf-8b71adfac09b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73705bd3-4a')
Nov 16 05:46:57 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Deleting instance files /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279_del
Nov 16 05:46:57 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Deletion of /opt/stack/data/nova/instances/310c7fc9-af32-42dd-be30-8460daa03279_del complete
Nov 16 05:46:57 user nova-compute[80928]: INFO nova.compute.manager [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 16 05:46:57 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:46:57 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:46:58 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:46:58 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Took 0.40 seconds to deallocate network for instance.
Nov 16 05:46:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-1896517b-f7db-48d1-a9c3-3596eaf9f0db req-1ed83d21-d532-43d8-aae2-0c2f51e0505d service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Received event network-vif-deleted-73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:46:58 user nova-compute[80928]: INFO nova.compute.manager [req-1896517b-f7db-48d1-a9c3-3596eaf9f0db req-1ed83d21-d532-43d8-aae2-0c2f51e0505d service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Neutron deleted interface 73705bd3-4a7a-4430-b6bf-8b71adfac09b; detaching it from the instance and deleting it from the info cache
Nov 16 05:46:58 user nova-compute[80928]: DEBUG nova.network.neutron [req-1896517b-f7db-48d1-a9c3-3596eaf9f0db req-1ed83d21-d532-43d8-aae2-0c2f51e0505d service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:46:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-1896517b-f7db-48d1-a9c3-3596eaf9f0db req-1ed83d21-d532-43d8-aae2-0c2f51e0505d service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Detach interface failed, port_id=73705bd3-4a7a-4430-b6bf-8b71adfac09b, reason: Instance 310c7fc9-af32-42dd-be30-8460daa03279 could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:46:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:58 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:46:58 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:46:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:58 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Deleted allocations for instance 310c7fc9-af32-42dd-be30-8460daa03279
Nov 16 05:46:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-39d2b7b7-91d5-4614-8c48-f47df898f9c0 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "310c7fc9-af32-42dd-be30-8460daa03279" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.549s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-6bf0a331-1c83-48d1-9cc6-08724e8ea7a9 req-6ecfd0fb-9167-4bcd-a10f-2926f98ab048 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Received event network-vif-plugged-73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:46:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6bf0a331-1c83-48d1-9cc6-08724e8ea7a9 req-6ecfd0fb-9167-4bcd-a10f-2926f98ab048 service nova] Acquiring lock "310c7fc9-af32-42dd-be30-8460daa03279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:46:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6bf0a331-1c83-48d1-9cc6-08724e8ea7a9 req-6ecfd0fb-9167-4bcd-a10f-2926f98ab048 service nova] Lock "310c7fc9-af32-42dd-be30-8460daa03279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:46:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6bf0a331-1c83-48d1-9cc6-08724e8ea7a9 req-6ecfd0fb-9167-4bcd-a10f-2926f98ab048 service nova] Lock "310c7fc9-af32-42dd-be30-8460daa03279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:46:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-6bf0a331-1c83-48d1-9cc6-08724e8ea7a9 req-6ecfd0fb-9167-4bcd-a10f-2926f98ab048 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] No waiting events found dispatching network-vif-plugged-73705bd3-4a7a-4430-b6bf-8b71adfac09b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:46:59 user nova-compute[80928]: WARNING nova.compute.manager [req-6bf0a331-1c83-48d1-9cc6-08724e8ea7a9 req-6ecfd0fb-9167-4bcd-a10f-2926f98ab048 service nova] [instance: 310c7fc9-af32-42dd-be30-8460daa03279] Received unexpected event network-vif-plugged-73705bd3-4a7a-4430-b6bf-8b71adfac09b for instance with vm_state deleted and task_state None.
Nov 16 05:47:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-ad1334c1-a74e-4d26-aa71-a51705926d4b req-46b9a29f-cf79-4f18-bec7-ceba44657d17 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Received event network-changed-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-ad1334c1-a74e-4d26-aa71-a51705926d4b req-46b9a29f-cf79-4f18-bec7-ceba44657d17 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Refreshing instance network info cache due to event network-changed-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:47:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ad1334c1-a74e-4d26-aa71-a51705926d4b req-46b9a29f-cf79-4f18-bec7-ceba44657d17 service nova] Acquiring lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:47:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ad1334c1-a74e-4d26-aa71-a51705926d4b req-46b9a29f-cf79-4f18-bec7-ceba44657d17 service nova] Acquired lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:47:00 user nova-compute[80928]: DEBUG nova.network.neutron [req-ad1334c1-a74e-4d26-aa71-a51705926d4b req-46b9a29f-cf79-4f18-bec7-ceba44657d17 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Refreshing network info cache for port 0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:47:00 user nova-compute[80928]: DEBUG nova.network.neutron [req-ad1334c1-a74e-4d26-aa71-a51705926d4b req-46b9a29f-cf79-4f18-bec7-ceba44657d17 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Updated VIF entry in instance network info cache for port 0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:47:00 user nova-compute[80928]: DEBUG nova.network.neutron [req-ad1334c1-a74e-4d26-aa71-a51705926d4b req-46b9a29f-cf79-4f18-bec7-ceba44657d17 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Updating instance_info_cache with network_info: [{"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:47:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ad1334c1-a74e-4d26-aa71-a51705926d4b req-46b9a29f-cf79-4f18-bec7-ceba44657d17 service nova] Releasing lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG nova.objects.instance [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lazy-loading 'flavor' on Instance uuid 6cc61915-ab05-4f3c-80ff-b873ae3dc68a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:01 user nova-compute[80928]: INFO nova.compute.manager [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Attaching volume a9390e5b-c017-42d0-a958-762778f940f0 to /dev/vdb
Nov 16 05:47:01 user nova-compute[80928]: DEBUG os_brick.utils [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ec7eb9-6472-4d98-9fdb-41c3fc551ef3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa7dcff-a0ab-4db2-a9fe-487f9b17de27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c02c53-d958-4dfe-a833-1d335b6d0669]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10c8c27-4d45-473d-8be4-5956c56c6f4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:47:01 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:47:01 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44cd7f0-d4aa-44d0-9d41-f0bac895e3f5]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG os_brick.utils [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:47:01 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Updating existing volume attachment record: b9a8bac6-f9fc-46d7-b921-9a48719744ac {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG nova.objects.instance [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'flavor' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:02 user nova-compute[80928]: INFO nova.compute.manager [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attaching volume c0c93f91-19fe-4859-b7e5-f5f970b68105 to /dev/vdb
Nov 16 05:47:02 user nova-compute[80928]: DEBUG os_brick.utils [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47d812f-be25-4528-b385-58e44d9ce152]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[814a3292-3f71-4dc1-805a-69b98bbbaa3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[df37b815-b7a5-4051-94d6-2a383561c2ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f08056-9e24-4820-a303-fbf7f57a0db8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:47:02 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fee8b4a-8543-4aa8-a2be-2e6e2492b586]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG os_brick.utils [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Updating existing volume attachment record: 3ead4940-a658-40bf-ad1a-d2a89d73bbbb {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:47:03 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "765e9a3f-b188-483c-b149-2df53766fed8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:04 user nova-compute[80928]: INFO nova.compute.manager [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Terminating instance
Nov 16 05:47:04 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-8b8b53f4-ce66-44b7-b35c-fa8db2c0d23c req-b2c77339-b321-4c2c-a765-cfa4481f0e1b service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-unplugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b8b53f4-ce66-44b7-b35c-fa8db2c0d23c req-b2c77339-b321-4c2c-a765-cfa4481f0e1b service nova] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b8b53f4-ce66-44b7-b35c-fa8db2c0d23c req-b2c77339-b321-4c2c-a765-cfa4481f0e1b service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b8b53f4-ce66-44b7-b35c-fa8db2c0d23c req-b2c77339-b321-4c2c-a765-cfa4481f0e1b service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-8b8b53f4-ce66-44b7-b35c-fa8db2c0d23c req-b2c77339-b321-4c2c-a765-cfa4481f0e1b service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] No waiting events found dispatching network-vif-unplugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:47:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-8b8b53f4-ce66-44b7-b35c-fa8db2c0d23c req-b2c77339-b321-4c2c-a765-cfa4481f0e1b service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-unplugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:05 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Instance destroyed successfully.
Nov 16 05:47:05 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lazy-loading 'resources' on Instance uuid 765e9a3f-b188-483c-b149-2df53766fed8 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-171787261',display_name='tempest-ServerActionsTestOtherA-server-171787261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-171787261',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIRZfEcvuwNYhj/y1xM6mcxohhx0m8ZHaUgJiSsxMQwSOGLIDwHJFsK0QD5y79ZqmyvT9tlBnMJypgzLM6OAyjdPrnmqxNSLqGp1Mi6dH0+QoZTXMm8gRWHjmecV7kNjw==',key_name='tempest-keypair-1523932878',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-he6qqyb2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=765e9a3f-b188-483c-b149-2df53766fed8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "address": "fa:16:3e:2c:8f:a2", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88de70f-c1", "ovs_interfaceid": "a88de70f-c14d-47d8-8b55-fd423eece4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_vif [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa88de70f-c1, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90313daf-ad6b-422d-b14e-e2e7452f7572) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:05 user nova-compute[80928]: INFO os_vif [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:8f:a2,bridge_name='br-int',has_traffic_filtering=True,id=a88de70f-c14d-47d8-8b55-fd423eece4d6,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88de70f-c1')
Nov 16 05:47:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVwTftrU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:47:05 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[589bc9d7-6024-4e12-921a-d0ebea59e0e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:47:05 user nova-compute[80928]: No targets found.
Nov 16 05:47:05 user nova-compute[80928]: iSNS:
Nov 16 05:47:05 user nova-compute[80928]: No targets found.
Nov 16 05:47:05 user nova-compute[80928]: STATIC:
Nov 16 05:47:05 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:47:05 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:47:05 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:47:05 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d
Nov 16 05:47:05 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:47:05 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:47:05 user nova-compute[80928]: FIRMWARE:
Nov 16 05:47:05 user nova-compute[80928]: No targets found.
Nov 16 05:47:05 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:47:05 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:47:05 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2918de0-39eb-44ff-9821-5f3d1715d6f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83252f1-4fcc-4341-b569-557387f946c2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:05 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:47:05 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:05 user nova-compute[80928]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d (non-flash)
Nov 16 05:47:05 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8678204430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7e34f8-3cff-48bc-b118-689c6f2edd76]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[328be5fe-cab3-4147-b16a-f205f5ae9587]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cfdd0b-ee6e-476e-8f8b-6cfcc94e72ed]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[912c8af5-e103-46cb-a143-d9b52f6736b3]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4a34593c-97ae968da29e635f', '/dev/disk/by-id/scsi-23937616539363864', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4a34593c') {{(pid=92262) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e561ac-398c-4fdc-b950-cbf2a0dbf84e]: (4, None) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6a5025-d270-4c30-a6e1-24fcfd127fd5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c19551-de87-4aff-95d4-7f31a074ea36]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260]
Nov 16 05:47:05 user nova-compute[80928]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d, portal: 172.16.0.220,3260] successful.
Nov 16 05:47:05 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a539086-0cc0-44fc-8cdf-7f4d8e85377d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeb25cb-71f5-46d0-99ae-2588d7f2451c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] <== disconnect_volume: return (335ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:47:05 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Deleting instance files /opt/stack/data/nova/instances/765e9a3f-b188-483c-b149-2df53766fed8_del
Nov 16 05:47:05 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Deletion of /opt/stack/data/nova/instances/765e9a3f-b188-483c-b149-2df53766fed8_del complete
Nov 16 05:47:05 user nova-compute[80928]: INFO nova.compute.manager [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 16 05:47:05 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:47:05 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:47:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:06 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:47:06 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Took 0.68 seconds to deallocate network for instance.
Nov 16 05:47:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-435892e1-0a82-40d1-a923-385076b53f93 req-1f7c8b40-d767-48e0-85ec-5bba224987a2 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-deleted-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:47:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-8899e3f6-2a79-4cdf-9917-bfb34bd32d9c req-b83ca2a0-f4b5-406b-8f9b-87fd9cb904c8 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8899e3f6-2a79-4cdf-9917-bfb34bd32d9c req-b83ca2a0-f4b5-406b-8f9b-87fd9cb904c8 service nova] Acquiring lock "765e9a3f-b188-483c-b149-2df53766fed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8899e3f6-2a79-4cdf-9917-bfb34bd32d9c req-b83ca2a0-f4b5-406b-8f9b-87fd9cb904c8 service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8899e3f6-2a79-4cdf-9917-bfb34bd32d9c req-b83ca2a0-f4b5-406b-8f9b-87fd9cb904c8 service nova] Lock "765e9a3f-b188-483c-b149-2df53766fed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-8899e3f6-2a79-4cdf-9917-bfb34bd32d9c req-b83ca2a0-f4b5-406b-8f9b-87fd9cb904c8 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] No waiting events found dispatching network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:47:06 user nova-compute[80928]: WARNING nova.compute.manager [req-8899e3f6-2a79-4cdf-9917-bfb34bd32d9c req-b83ca2a0-f4b5-406b-8f9b-87fd9cb904c8 service nova] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Received unexpected event network-vif-plugged-a88de70f-c14d-47d8-8b55-fd423eece4d6 for instance with vm_state active and task_state deleting.
Nov 16 05:47:07 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:47:08 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:47:08 user nova-compute[80928]: INFO nova.compute.manager [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Took 2.48 seconds to detach 1 volumes for instance.
Nov 16 05:47:08 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 765e9a3f-b188-483c-b149-2df53766fed8] Deleting volume: 0a539086-0cc0-44fc-8cdf-7f4d8e85377d {{(pid=80928) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIvoUdmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:47:09 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:47:09 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:47:09 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOQIChwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:47:09 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a833bb6-3179-4f3b-80ca-4bc60eaf045b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:47:09 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[375dcd70-ba84-4802-a663-6de7064b84db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0] added
Nov 16 05:47:09 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3aa5bc3-ba4d-490d-a7a3-010f7b5ed6d5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cf54f8-16d1-4040-b6df-e40af544a239]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIvoUdmp {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIvoUdmp" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[183792fc-a681-4fe3-b63b-b05bb0d5e15c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wIvoUdmp'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a16030-a7e1-453b-ac26-f3c30d6e7a8b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5556412f-9ffd-47b0-becc-9e26f61f1178]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:09 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:09 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[13667030-fbd4-4e50-9df2-02560cff32fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0, portal: 172.16.0.220,3260]
Nov 16 05:47:09 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0, portal: 172.16.0.220,3260] successful.
Nov 16 05:47:09 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b0855a-2ff4-4052-a96b-3bc3024a0e30]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d953ad-7560-43c5-bd8b-a99fdf8f2753]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:09 user nova-compute[80928]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 (non-flash)
Nov 16 05:47:09 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:09 user nova-compute[80928]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 (non-flash)
Nov 16 05:47:09 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fdcf49-4bc3-4c3e-9c3a-cfdc6fe2894f]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:47:09 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.839s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:10 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Deleted allocations for instance 765e9a3f-b188-483c-b149-2df53766fed8
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f4c78316-bb28-4847-9cd2-17c7ab370993 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "765e9a3f-b188-483c-b149-2df53766fed8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.736s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIvoUdmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26663343636396638', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663343636396638', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.319s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:47:10 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:47:10 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG nova.objects.instance [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lazy-loading 'flavor' on Instance uuid 6cc61915-ab05-4f3c-80ff-b873ae3dc68a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e699fd-75c6-4c37-9927-cfa5fe6abeb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:47:10 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:47:10 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:47:10 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 05:47:10 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:47:10 user nova-compute[80928]:   <serial>a9390e5b-c017-42d0-a958-762778f940f0</serial>
Nov 16 05:47:10 user nova-compute[80928]: </disk>
Nov 16 05:47:10 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4217df78-8c7b-4aee-bb3c-515844557bed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105] added
Nov 16 05:47:10 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8c7fc9-7a44-49f4-978a-7ab11bfda348]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[70475033-38de-4446-8ea4-87820e11421e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fOQIChwj {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fOQIChwj" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[14692c91-94ac-405a-84c8-aea9b74fca1d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fOQIChwj'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e56196-82f3-4d44-a2c2-cce020e164ea]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cf7cda-4c99-4a29-9305-516c9b7432f2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:10 user nova-compute[80928]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 (non-flash)
Nov 16 05:47:10 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:10 user nova-compute[80928]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 (non-flash)
Nov 16 05:47:10 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a547a5-0b73-4881-8290-a3a7a6687231]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105, portal: 172.16.0.220,3260]
Nov 16 05:47:10 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105, portal: 172.16.0.220,3260] successful.
Nov 16 05:47:10 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[944e05dc-eb3a-4266-803e-273ee7beddcf]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf69238-39a6-45c3-9236-0c53e9c1da4a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:10 user nova-compute[80928]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 (non-flash)
Nov 16 05:47:10 user nova-compute[80928]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 (non-flash)
Nov 16 05:47:10 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:10 user nova-compute[80928]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 (non-flash)
Nov 16 05:47:10 user nova-compute[80928]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 (non-flash)
Nov 16 05:47:10 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b30834-e018-4ea5-9e5a-193dab806739]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] No VIF found with MAC fa:16:3e:40:c7:4b, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 05:47:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-068f1c0b-b4bb-4b1d-ab69-bc1d70c9f1ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.234s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:11 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:47:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOQIChwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:47:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:47:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] <== connect_volume: return (2627ms) {'type': 'block', 'scsi_wwn': '23730636262633861', 'path': '/dev/sdd'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:47:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730636262633861', 'path': '/dev/sdd'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:47:11 user nova-compute[80928]: DEBUG nova.objects.instance [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'flavor' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:11 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:47:11 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:47:11 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:47:11 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:47:11 user nova-compute[80928]:   <serial>c0c93f91-19fe-4859-b7e5-f5f970b68105</serial>
Nov 16 05:47:11 user nova-compute[80928]: </disk>
Nov 16 05:47:11 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:47:11 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:47:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:47:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:47:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No VIF found with MAC fa:16:3e:fa:d8:93, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:47:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b3370afa-eac8-4ce1-b3ad-35926e9733a4 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.973s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:12 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:47:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:12 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:47:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:12 user nova-compute[80928]: INFO nova.compute.manager [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Detaching volume a9390e5b-c017-42d0-a958-762778f940f0
Nov 16 05:47:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:13 user nova-compute[80928]: INFO nova.virt.block_device [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Attempting to driver detach volume a9390e5b-c017-42d0-a958-762778f940f0 from mountpoint /dev/vdb
Nov 16 05:47:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Attempting to detach device vdb from instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:47:13 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:47:13 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 05:47:13 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:47:13 user nova-compute[80928]:   <serial>a9390e5b-c017-42d0-a958-762778f940f0</serial>
Nov 16 05:47:13 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:47:13 user nova-compute[80928]: </disk>
Nov 16 05:47:13 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:47:13 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Successfully detached device vdb from instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a from the persistent domain config.
Nov 16 05:47:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:47:13 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:47:13 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 05:47:13 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:47:13 user nova-compute[80928]:   <serial>a9390e5b-c017-42d0-a958-762778f940f0</serial>
Nov 16 05:47:13 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:47:13 user nova-compute[80928]: </disk>
Nov 16 05:47:13 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:14 user nova-compute[80928]: INFO nova.compute.manager [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Detaching volume c0c93f91-19fe-4859-b7e5-f5f970b68105
Nov 16 05:47:15 user nova-compute[80928]: INFO nova.virt.block_device [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attempting to driver detach volume c0c93f91-19fe-4859-b7e5-f5f970b68105 from mountpoint /dev/vdb
Nov 16 05:47:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Attempting to detach device vdb from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:47:15 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:47:15 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:47:15 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:47:15 user nova-compute[80928]:   <serial>c0c93f91-19fe-4859-b7e5-f5f970b68105</serial>
Nov 16 05:47:15 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:47:15 user nova-compute[80928]: </disk>
Nov 16 05:47:15 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:47:15 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Successfully detached device vdb from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the persistent domain config.
Nov 16 05:47:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:47:15 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:47:15 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:47:15 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:47:15 user nova-compute[80928]:   <serial>c0c93f91-19fe-4859-b7e5-f5f970b68105</serial>
Nov 16 05:47:15 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:47:15 user nova-compute[80928]: </disk>
Nov 16 05:47:15 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:16 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:47:16 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8028MB free_disk=25.215160369873047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 762caa99-5c4a-428d-8059-7903d0bdb149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance a39e1ed9-2651-4de2-8979-c030b02b0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:47:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:19 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:47:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:47:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:47:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:33 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a is timed out.
Nov 16 05:47:33 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Successfully detached device vdb from instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a from the live domain config.
Nov 16 05:47:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIvoUdmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:47:33 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f708607c-9d4a-4934-a11d-d9d5e09f41b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:47:33 user nova-compute[80928]: No targets found.
Nov 16 05:47:33 user nova-compute[80928]: iSNS:
Nov 16 05:47:33 user nova-compute[80928]: No targets found.
Nov 16 05:47:33 user nova-compute[80928]: STATIC:
Nov 16 05:47:33 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0
Nov 16 05:47:33 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:47:33 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:47:33 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105
Nov 16 05:47:33 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:47:33 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:47:33 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:47:33 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:47:33 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:47:33 user nova-compute[80928]: FIRMWARE:
Nov 16 05:47:33 user nova-compute[80928]: No targets found.
Nov 16 05:47:33 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:47:33 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:47:33 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f281657-e47e-4d0b-86e0-1bfe3a792fce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2873c56-8180-420e-8258-98c703c7c546]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:33 user nova-compute[80928]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 (non-flash)
Nov 16 05:47:33 user nova-compute[80928]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 (non-flash)
Nov 16 05:47:33 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:33 user nova-compute[80928]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 (non-flash)
Nov 16 05:47:33 user nova-compute[80928]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 (non-flash)
Nov 16 05:47:33 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f868999f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5134466a-328d-4b34-ba1b-3a12ff531c09]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[924c7479-d9ff-4ec9-b9db-2fde11b3b989]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[09805017-2569-4562-9fcf-a574629ec659]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09fdc88-3954-4e05-b2a8-91cdfc267f76]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e79eba0-3af7-440b-80ea-1860a3d978e3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc164474-c0bc-49d9-9705-c59a12b1f314]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0, portal: 172.16.0.220,3260]
Nov 16 05:47:33 user nova-compute[80928]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0, portal: 172.16.0.220,3260] successful.
Nov 16 05:47:33 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9390e5b-c017-42d0-a958-762778f940f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e861988-ad5c-4490-a9cb-87ce050ae49b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] <== disconnect_volume: return (304ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:47:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:47:34 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lazy-loading 'flavor' on Instance uuid 6cc61915-ab05-4f3c-80ff-b873ae3dc68a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c1379445-7627-4491-bbfb-ee33431834ea tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.686s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Acquiring lock "e6ff1633-6efc-4953-94c0-37dfca5eb077" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:47:35 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af is timed out.
Nov 16 05:47:35 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Successfully detached device vdb from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the live domain config.
Nov 16 05:47:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOQIChwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:47:35 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b74a703-6d1e-48bf-b69e-57e0caadae8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:47:35 user nova-compute[80928]: No targets found.
Nov 16 05:47:35 user nova-compute[80928]: iSNS:
Nov 16 05:47:35 user nova-compute[80928]: No targets found.
Nov 16 05:47:35 user nova-compute[80928]: STATIC:
Nov 16 05:47:35 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105
Nov 16 05:47:35 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:47:35 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:47:35 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:47:35 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:47:35 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:47:35 user nova-compute[80928]: FIRMWARE:
Nov 16 05:47:35 user nova-compute[80928]: No targets found.
Nov 16 05:47:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:47:35 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:47:35 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:47:35 user nova-compute[80928]: INFO nova.compute.claims [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Claim successful on node user
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d449bd-b54c-4e36-8d0a-3e203700ab80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[107274a4-a3c8-429e-8b5b-86d6b4aad6d4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:35 user nova-compute[80928]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 (non-flash)
Nov 16 05:47:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:35 user nova-compute[80928]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 (non-flash)
Nov 16 05:47:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86880eac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105'): ({'sdd'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Removing single pathed devices sdd {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa123aa6-d49b-4768-b704-419a79cb63b7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab134efd-06f2-4605-8ce5-29ab69a62bb8]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Flushing IO for device /dev/sdd {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccae150-52d5-4325-9c94-1c87764571c8]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d933661-d569-4742-a6a3-d94d25e45b49]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f785053f-ccd3-4840-b19d-1b811a3e0f6e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[756d287f-722a-43ff-ab99-06a2514d76b8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105, portal: 172.16.0.220,3260]
Nov 16 05:47:35 user nova-compute[80928]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105, portal: 172.16.0.220,3260] successful.
Nov 16 05:47:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c93f91-19fe-4859-b7e5-f5f970b68105 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[80697d7e-eb14-464c-a79e-d9bb2d03f8af]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] <== disconnect_volume: return (339ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:47:35 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:47:36 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:47:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:47:36 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Creating image(s)
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "/opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "/opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG nova.policy [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2a2fb6c2d474177b92c5b3818fe492f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d01062a1fa849f1adce598ee2e8d82f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG nova.objects.instance [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'flavor' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.187s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk 1073741824" returned: 0 in 0.053s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9a642e50-7563-425d-adde-390329550dff tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.782s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:47:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:37 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Cannot resize image /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:47:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:47:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Ensure instance console log exists: /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:47:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:37 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Successfully created port: 524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:47:37 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Successfully updated port: 524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:47:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Acquiring lock "refresh_cache-e6ff1633-6efc-4953-94c0-37dfca5eb077" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:47:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Acquired lock "refresh_cache-e6ff1633-6efc-4953-94c0-37dfca5eb077" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:47:37 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-828f255f-b2f4-4cba-817f-1202521baac9 req-07ac4dc4-46ae-42ae-a0ee-768b2ec4a46a service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Received event network-changed-524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-828f255f-b2f4-4cba-817f-1202521baac9 req-07ac4dc4-46ae-42ae-a0ee-768b2ec4a46a service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Refreshing instance network info cache due to event network-changed-524ec955-2738-4212-90ba-e23f9804ac4f. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-828f255f-b2f4-4cba-817f-1202521baac9 req-07ac4dc4-46ae-42ae-a0ee-768b2ec4a46a service nova] Acquiring lock "refresh_cache-e6ff1633-6efc-4953-94c0-37dfca5eb077" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.network.neutron [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Updating instance_info_cache with network_info: [{"id": "524ec955-2738-4212-90ba-e23f9804ac4f", "address": "fa:16:3e:35:1d:37", "network": {"id": "1f73cebe-2904-47e2-ba79-836411d9f25e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "28be64da55224dbd92019438281cfb48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524ec955-27", "ovs_interfaceid": "524ec955-2738-4212-90ba-e23f9804ac4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Releasing lock "refresh_cache-e6ff1633-6efc-4953-94c0-37dfca5eb077" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Instance network_info: |[{"id": "524ec955-2738-4212-90ba-e23f9804ac4f", "address": "fa:16:3e:35:1d:37", "network": {"id": "1f73cebe-2904-47e2-ba79-836411d9f25e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "28be64da55224dbd92019438281cfb48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524ec955-27", "ovs_interfaceid": "524ec955-2738-4212-90ba-e23f9804ac4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-828f255f-b2f4-4cba-817f-1202521baac9 req-07ac4dc4-46ae-42ae-a0ee-768b2ec4a46a service nova] Acquired lock "refresh_cache-e6ff1633-6efc-4953-94c0-37dfca5eb077" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.network.neutron [req-828f255f-b2f4-4cba-817f-1202521baac9 req-07ac4dc4-46ae-42ae-a0ee-768b2ec4a46a service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Refreshing network info cache for port 524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Start _get_guest_xml network_info=[{"id": "524ec955-2738-4212-90ba-e23f9804ac4f", "address": "fa:16:3e:35:1d:37", "network": {"id": "1f73cebe-2904-47e2-ba79-836411d9f25e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "28be64da55224dbd92019438281cfb48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524ec955-27", "ovs_interfaceid": "524ec955-2738-4212-90ba-e23f9804ac4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:47:38 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:47:38 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1392975638',display_name='tempest-VolumesNegativeTest-instance-1392975638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1392975638',id=36,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d01062a1fa849f1adce598ee2e8d82f',ramdisk_id='',reservation_id='r-kdtc1miz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-594880716',owner_user_name='tempest-VolumesNegativeTest-594880716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:47:36Z,user_data=None,user_id='f2a2fb6c2d474177b92c5b3818fe492f',uuid=e6ff1633-6efc-4953-94c0-37dfca5eb077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "524ec955-2738-4212-90ba-e23f9804ac4f", "address": "fa:16:3e:35:1d:37", "network": {"id": "1f73cebe-2904-47e2-ba79-836411d9f25e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "28be64da55224dbd92019438281cfb48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524ec955-27", "ovs_interfaceid": "524ec955-2738-4212-90ba-e23f9804ac4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Converting VIF {"id": "524ec955-2738-4212-90ba-e23f9804ac4f", "address": "fa:16:3e:35:1d:37", "network": {"id": "1f73cebe-2904-47e2-ba79-836411d9f25e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "28be64da55224dbd92019438281cfb48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524ec955-27", "ovs_interfaceid": "524ec955-2738-4212-90ba-e23f9804ac4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1d:37,bridge_name='br-int',has_traffic_filtering=True,id=524ec955-2738-4212-90ba-e23f9804ac4f,network=Network(1f73cebe-2904-47e2-ba79-836411d9f25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524ec955-27') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lazy-loading 'pci_devices' on Instance uuid e6ff1633-6efc-4953-94c0-37dfca5eb077 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:47:38 user nova-compute[80928]:   <uuid>e6ff1633-6efc-4953-94c0-37dfca5eb077</uuid>
Nov 16 05:47:38 user nova-compute[80928]:   <name>instance-00000024</name>
Nov 16 05:47:38 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:47:38 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:47:38 user nova-compute[80928]:   <metadata>
Nov 16 05:47:38 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:47:38 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:47:38 user nova-compute[80928]:       <nova:name>tempest-VolumesNegativeTest-instance-1392975638</nova:name>
Nov 16 05:47:38 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:47:38</nova:creationTime>
Nov 16 05:47:38 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:47:38 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:47:38 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:47:38 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:47:38 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:47:38 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:47:38 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:47:38 user nova-compute[80928]:       <nova:owner>
Nov 16 05:47:38 user nova-compute[80928]:         <nova:user uuid="f2a2fb6c2d474177b92c5b3818fe492f">tempest-VolumesNegativeTest-594880716-project-member</nova:user>
Nov 16 05:47:38 user nova-compute[80928]:         <nova:project uuid="1d01062a1fa849f1adce598ee2e8d82f">tempest-VolumesNegativeTest-594880716</nova:project>
Nov 16 05:47:38 user nova-compute[80928]:       </nova:owner>
Nov 16 05:47:38 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:47:38 user nova-compute[80928]:       <nova:ports>
Nov 16 05:47:38 user nova-compute[80928]:         <nova:port uuid="524ec955-2738-4212-90ba-e23f9804ac4f">
Nov 16 05:47:38 user nova-compute[80928]:           <nova:ip type="fixed" address="192.168.233.67" ipVersion="4"/>
Nov 16 05:47:38 user nova-compute[80928]:         </nova:port>
Nov 16 05:47:38 user nova-compute[80928]:       </nova:ports>
Nov 16 05:47:38 user nova-compute[80928]:     </nova:instance>
Nov 16 05:47:38 user nova-compute[80928]:   </metadata>
Nov 16 05:47:38 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:47:38 user nova-compute[80928]:     <system>
Nov 16 05:47:38 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:47:38 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:47:38 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:47:38 user nova-compute[80928]:       <entry name="serial">e6ff1633-6efc-4953-94c0-37dfca5eb077</entry>
Nov 16 05:47:38 user nova-compute[80928]:       <entry name="uuid">e6ff1633-6efc-4953-94c0-37dfca5eb077</entry>
Nov 16 05:47:38 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:47:38 user nova-compute[80928]:     </system>
Nov 16 05:47:38 user nova-compute[80928]:   </sysinfo>
Nov 16 05:47:38 user nova-compute[80928]:   <os>
Nov 16 05:47:38 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:47:38 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:47:38 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:47:38 user nova-compute[80928]:   </os>
Nov 16 05:47:38 user nova-compute[80928]:   <features>
Nov 16 05:47:38 user nova-compute[80928]:     <acpi/>
Nov 16 05:47:38 user nova-compute[80928]:     <apic/>
Nov 16 05:47:38 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:47:38 user nova-compute[80928]:   </features>
Nov 16 05:47:38 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:47:38 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:47:38 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:47:38 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:47:38 user nova-compute[80928]:   </clock>
Nov 16 05:47:38 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:47:38 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:47:38 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:47:38 user nova-compute[80928]:   </cpu>
Nov 16 05:47:38 user nova-compute[80928]:   <devices>
Nov 16 05:47:38 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:47:38 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:47:38 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk"/>
Nov 16 05:47:38 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:47:38 user nova-compute[80928]:     </disk>
Nov 16 05:47:38 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:47:38 user nova-compute[80928]:       <mac address="fa:16:3e:35:1d:37"/>
Nov 16 05:47:38 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:47:38 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:47:38 user nova-compute[80928]:       <target dev="tap524ec955-27"/>
Nov 16 05:47:38 user nova-compute[80928]:     </interface>
Nov 16 05:47:38 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:47:38 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/console.log" append="off"/>
Nov 16 05:47:38 user nova-compute[80928]:     </serial>
Nov 16 05:47:38 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:47:38 user nova-compute[80928]:     <video>
Nov 16 05:47:38 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:47:38 user nova-compute[80928]:     </video>
Nov 16 05:47:38 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:47:38 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:47:38 user nova-compute[80928]:     </rng>
Nov 16 05:47:38 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:47:38 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:47:38 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:47:38 user nova-compute[80928]:     </memballoon>
Nov 16 05:47:38 user nova-compute[80928]:   </devices>
Nov 16 05:47:38 user nova-compute[80928]: </domain>
Nov 16 05:47:38 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1392975638',display_name='tempest-VolumesNegativeTest-instance-1392975638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1392975638',id=36,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d01062a1fa849f1adce598ee2e8d82f',ramdisk_id='',reservation_id='r-kdtc1miz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-594880716',owner_user_name='tempest-VolumesNegativeTest-594880716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:47:36Z,user_data=None,user_id='f2a2fb6c2d474177b92c5b3818fe492f',uuid=e6ff1633-6efc-4953-94c0-37dfca5eb077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "524ec955-2738-4212-90ba-e23f9804ac4f", "address": "fa:16:3e:35:1d:37", "network": {"id": "1f73cebe-2904-47e2-ba79-836411d9f25e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "28be64da55224dbd92019438281cfb48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524ec955-27", "ovs_interfaceid": "524ec955-2738-4212-90ba-e23f9804ac4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Converting VIF {"id": "524ec955-2738-4212-90ba-e23f9804ac4f", "address": "fa:16:3e:35:1d:37", "network": {"id": "1f73cebe-2904-47e2-ba79-836411d9f25e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "28be64da55224dbd92019438281cfb48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524ec955-27", "ovs_interfaceid": "524ec955-2738-4212-90ba-e23f9804ac4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1d:37,bridge_name='br-int',has_traffic_filtering=True,id=524ec955-2738-4212-90ba-e23f9804ac4f,network=Network(1f73cebe-2904-47e2-ba79-836411d9f25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524ec955-27') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG os_vif [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1d:37,bridge_name='br-int',has_traffic_filtering=True,id=524ec955-2738-4212-90ba-e23f9804ac4f,network=Network(1f73cebe-2904-47e2-ba79-836411d9f25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524ec955-27') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '645efe64-03e2-58fd-8c25-54bc519f9ee3', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap524ec955-27, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap524ec955-27, col_values=(('qos', UUID('05c94933-baa2-40de-bfbe-18fa902829c3')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap524ec955-27, col_values=(('external_ids', {'iface-id': '524ec955-2738-4212-90ba-e23f9804ac4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:1d:37', 'vm-uuid': 'e6ff1633-6efc-4953-94c0-37dfca5eb077'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:38 user nova-compute[80928]: INFO os_vif [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1d:37,bridge_name='br-int',has_traffic_filtering=True,id=524ec955-2738-4212-90ba-e23f9804ac4f,network=Network(1f73cebe-2904-47e2-ba79-836411d9f25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524ec955-27')
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] No VIF found with MAC fa:16:3e:35:1d:37, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.network.neutron [req-828f255f-b2f4-4cba-817f-1202521baac9 req-07ac4dc4-46ae-42ae-a0ee-768b2ec4a46a service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Updated VIF entry in instance network info cache for port 524ec955-2738-4212-90ba-e23f9804ac4f. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG nova.network.neutron [req-828f255f-b2f4-4cba-817f-1202521baac9 req-07ac4dc4-46ae-42ae-a0ee-768b2ec4a46a service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Updating instance_info_cache with network_info: [{"id": "524ec955-2738-4212-90ba-e23f9804ac4f", "address": "fa:16:3e:35:1d:37", "network": {"id": "1f73cebe-2904-47e2-ba79-836411d9f25e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "28be64da55224dbd92019438281cfb48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524ec955-27", "ovs_interfaceid": "524ec955-2738-4212-90ba-e23f9804ac4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-828f255f-b2f4-4cba-817f-1202521baac9 req-07ac4dc4-46ae-42ae-a0ee-768b2ec4a46a service nova] Releasing lock "refresh_cache-e6ff1633-6efc-4953-94c0-37dfca5eb077" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:47:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-60672373-b549-4eb7-b880-381c3d0af4df req-65ba5d60-95f0-42e3-9dae-38741a971d9e service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Received event network-vif-plugged-524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-60672373-b549-4eb7-b880-381c3d0af4df req-65ba5d60-95f0-42e3-9dae-38741a971d9e service nova] Acquiring lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-60672373-b549-4eb7-b880-381c3d0af4df req-65ba5d60-95f0-42e3-9dae-38741a971d9e service nova] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-60672373-b549-4eb7-b880-381c3d0af4df req-65ba5d60-95f0-42e3-9dae-38741a971d9e service nova] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-60672373-b549-4eb7-b880-381c3d0af4df req-65ba5d60-95f0-42e3-9dae-38741a971d9e service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] No waiting events found dispatching network-vif-plugged-524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:47:40 user nova-compute[80928]: WARNING nova.compute.manager [req-60672373-b549-4eb7-b880-381c3d0af4df req-65ba5d60-95f0-42e3-9dae-38741a971d9e service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Received unexpected event network-vif-plugged-524ec955-2738-4212-90ba-e23f9804ac4f for instance with vm_state building and task_state spawning.
Nov 16 05:47:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-facc8977-10dd-4b54-a46c-3ecd97d6e8a2 req-cb6c8fe5-b606-4989-8964-8ca3c423966a service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-changed-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-facc8977-10dd-4b54-a46c-3ecd97d6e8a2 req-cb6c8fe5-b606-4989-8964-8ca3c423966a service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Refreshing instance network info cache due to event network-changed-d5c7e129-4809-463e-b3c9-5091f165e8c5. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-facc8977-10dd-4b54-a46c-3ecd97d6e8a2 req-cb6c8fe5-b606-4989-8964-8ca3c423966a service nova] Acquiring lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-facc8977-10dd-4b54-a46c-3ecd97d6e8a2 req-cb6c8fe5-b606-4989-8964-8ca3c423966a service nova] Acquired lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:47:40 user nova-compute[80928]: DEBUG nova.network.neutron [req-facc8977-10dd-4b54-a46c-3ecd97d6e8a2 req-cb6c8fe5-b606-4989-8964-8ca3c423966a service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Refreshing network info cache for port d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:47:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:41 user nova-compute[80928]: DEBUG nova.network.neutron [req-facc8977-10dd-4b54-a46c-3ecd97d6e8a2 req-cb6c8fe5-b606-4989-8964-8ca3c423966a service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updated VIF entry in instance network info cache for port d5c7e129-4809-463e-b3c9-5091f165e8c5. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:47:41 user nova-compute[80928]: DEBUG nova.network.neutron [req-facc8977-10dd-4b54-a46c-3ecd97d6e8a2 req-cb6c8fe5-b606-4989-8964-8ca3c423966a service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updating instance_info_cache with network_info: [{"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:47:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-facc8977-10dd-4b54-a46c-3ecd97d6e8a2 req-cb6c8fe5-b606-4989-8964-8ca3c423966a service nova] Releasing lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.objects.instance [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'flavor' on Instance uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:47:42 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Instance spawned successfully.
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:42 user nova-compute[80928]: INFO nova.compute.manager [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Attaching volume b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a to /dev/vdb
Nov 16 05:47:42 user nova-compute[80928]: INFO nova.compute.manager [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-99722f3f-74bd-46e6-b529-ea38723a8391 req-a69e1aca-7158-4919-820d-8f4cd18ee0e8 service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Received event network-vif-plugged-524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-99722f3f-74bd-46e6-b529-ea38723a8391 req-a69e1aca-7158-4919-820d-8f4cd18ee0e8 service nova] Acquiring lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-99722f3f-74bd-46e6-b529-ea38723a8391 req-a69e1aca-7158-4919-820d-8f4cd18ee0e8 service nova] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-99722f3f-74bd-46e6-b529-ea38723a8391 req-a69e1aca-7158-4919-820d-8f4cd18ee0e8 service nova] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-99722f3f-74bd-46e6-b529-ea38723a8391 req-a69e1aca-7158-4919-820d-8f4cd18ee0e8 service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] No waiting events found dispatching network-vif-plugged-524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:47:42 user nova-compute[80928]: WARNING nova.compute.manager [req-99722f3f-74bd-46e6-b529-ea38723a8391 req-a69e1aca-7158-4919-820d-8f4cd18ee0e8 service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Received unexpected event network-vif-plugged-524ec955-2738-4212-90ba-e23f9804ac4f for instance with vm_state building and task_state spawning.
Nov 16 05:47:42 user nova-compute[80928]: DEBUG os_brick.utils [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[329f6f9a-e002-4b92-87d5-7187928ce7b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:42 user nova-compute[80928]: INFO nova.compute.manager [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Took 6.82 seconds to build instance.
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c95523c9-7bbe-4213-a0b3-90d2b7ad333e tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.915s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d106e8-5e2e-4620-b7d9-4b8f60afba9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4ef625-271c-4da8-aad6-0d0d3a10a211]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46999a0-4683-43a4-a085-cf5f7a943fe3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:47:42 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:47:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d23b86-a8b1-4316-bfdd-389b4213db71]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG os_brick.utils [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:47:42 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updating existing volume attachment record: 14892b68-67ed-4b14-b080-a993678cc06a {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:47:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHGQUbkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:47:47 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:47:47 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:47:47 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d495bb-5756-4169-9e6b-3f1b0285f281]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:47:47 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f48250-ca4e-4a6b-85bd-ac1cf60e01f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a] added
Nov 16 05:47:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9131c406-bd1f-4898-a674-24b73642b8f3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38ae7b5-1e61-47a7-8536-3afecfb5cf30]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xHGQUbkI {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xHGQUbkI" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d0428a-cb03-404a-b095-3abd581a9f11]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xHGQUbkI'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:47 user nova-compute[80928]: INFO nova.compute.manager [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Terminating instance
Nov 16 05:47:47 user nova-compute[80928]: DEBUG nova.compute.manager [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9accffc-81da-4d52-bc15-33d0de5e2c5a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d692f733-76d1-4c67-8c54-671d58826a35]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6ae39d-c4d0-4197-93c7-f42894129648]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a, portal: 172.16.0.220,3260]
Nov 16 05:47:47 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a, portal: 172.16.0.220,3260] successful.
Nov 16 05:47:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee64e05-7aea-4a05-a570-5951a87db8f1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa393aba-162b-4735-bcf9-84f9c86ff0e0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:47 user nova-compute[80928]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:47:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:47 user nova-compute[80928]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:47:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dde1a03-4c08-4cde-a2cb-70dce13a0975]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHGQUbkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-686e2749-a0f6-41f1-b046-1e8c4cdd15dd req-095ecc20-2097-470f-afe6-b898ec37bcfe service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-unplugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-686e2749-a0f6-41f1-b046-1e8c4cdd15dd req-095ecc20-2097-470f-afe6-b898ec37bcfe service nova] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-686e2749-a0f6-41f1-b046-1e8c4cdd15dd req-095ecc20-2097-470f-afe6-b898ec37bcfe service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-686e2749-a0f6-41f1-b046-1e8c4cdd15dd req-095ecc20-2097-470f-afe6-b898ec37bcfe service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-686e2749-a0f6-41f1-b046-1e8c4cdd15dd req-095ecc20-2097-470f-afe6-b898ec37bcfe service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] No waiting events found dispatching network-vif-unplugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-686e2749-a0f6-41f1-b046-1e8c4cdd15dd req-095ecc20-2097-470f-afe6-b898ec37bcfe service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-unplugged-af4426f7-2ac8-4035-98b1-7739d2acf95b for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:48 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Instance destroyed successfully.
Nov 16 05:47:48 user nova-compute[80928]: DEBUG nova.objects.instance [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'resources' on Instance uuid a39e1ed9-2651-4de2-8979-c030b02b0ee1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:31:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-71404799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-71404799',id=14,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:33:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-l2xlwmyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:35:45Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=a39e1ed9-2651-4de2-8979-c030b02b0ee1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "address": "fa:16:3e:e5:51:e7", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4426f7-2a", "ovs_interfaceid": "af4426f7-2ac8-4035-98b1-7739d2acf95b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=af4426f7-2ac8-4035-98b1-7739d2acf95b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4426f7-2a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_vif [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=af4426f7-2ac8-4035-98b1-7739d2acf95b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4426f7-2a') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf4426f7-2a, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4490346-c7a0-454d-a724-834f334d9bd2) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:47:48 user nova-compute[80928]: INFO os_vif [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=af4426f7-2ac8-4035-98b1-7739d2acf95b,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4426f7-2a')
Nov 16 05:47:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPXoqICg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:47:48 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23130353739343032', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130353739343032', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.400s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.047s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0fdb5a-230e-446d-9c88-1ada37b7daf2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:47:48 user nova-compute[80928]: No targets found.
Nov 16 05:47:48 user nova-compute[80928]: iSNS:
Nov 16 05:47:48 user nova-compute[80928]: No targets found.
Nov 16 05:47:48 user nova-compute[80928]: STATIC:
Nov 16 05:47:48 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a
Nov 16 05:47:48 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:47:48 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:47:48 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81
Nov 16 05:47:48 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:47:48 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:47:48 user nova-compute[80928]: FIRMWARE:
Nov 16 05:47:48 user nova-compute[80928]: No targets found.
Nov 16 05:47:48 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:47:48 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:47:48 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG nova.objects.instance [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'flavor' on Instance uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a987335-0629-453c-bb37-598d1a7892d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:47:48 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:47:48 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 05:47:48 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:47:48 user nova-compute[80928]:   <serial>b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a</serial>
Nov 16 05:47:48 user nova-compute[80928]: </disk>
Nov 16 05:47:48 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4178eb9-1409-459f-9f18-4eec84012de0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:48 user nova-compute[80928]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:47:48 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 (non-flash)
Nov 16 05:47:48 user nova-compute[80928]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:47:48 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86781271c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b4f0ff-be45-4f14-846d-a44326104f42]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f61eb8-8254-43d3-94e3-08ebaefe9dd5]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c04a35-6fa3-4c97-9e50-87e78f41975d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8c3c86-ebb1-4877-9468-4b3424fa7a1e]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:47:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad8fcf-9656-47ea-bfb8-ea416dd4931d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0ecf59-084d-4e6e-9f15-cd2efda03f64]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81, portal: 172.16.0.220,3260]
Nov 16 05:47:49 user nova-compute[80928]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81, portal: 172.16.0.220,3260] successful.
Nov 16 05:47:49 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23705545-4fdf-464f-8bd3-064fcf28ed81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[828bffa4-88ea-4e77-b74c-675f28aa09f9]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] <== disconnect_volume: return (764ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:47:49 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Deleting instance files /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1_del
Nov 16 05:47:49 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Deletion of /opt/stack/data/nova/instances/a39e1ed9-2651-4de2-8979-c030b02b0ee1_del complete
Nov 16 05:47:49 user nova-compute[80928]: INFO nova.compute.manager [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Took 1.65 seconds to destroy the instance on the hypervisor.
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No VIF found with MAC fa:16:3e:b2:65:29, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-574c3695-7bc7-443f-b033-40e110eb513e tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.200s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:47:49 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Took 0.50 seconds to deallocate network for instance.
Nov 16 05:47:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-17026a99-c612-48a9-b4b5-53bfcc0170ee req-6a8d0304-1aba-4de4-a5e0-ac7c808c8e85 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-deleted-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-6d25f948-f10c-47a6-810e-7a207e235f6e req-27301fa0-f51a-470e-b1c7-4379ca374b64 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6d25f948-f10c-47a6-810e-7a207e235f6e req-27301fa0-f51a-470e-b1c7-4379ca374b64 service nova] Acquiring lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6d25f948-f10c-47a6-810e-7a207e235f6e req-27301fa0-f51a-470e-b1c7-4379ca374b64 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6d25f948-f10c-47a6-810e-7a207e235f6e req-27301fa0-f51a-470e-b1c7-4379ca374b64 service nova] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-6d25f948-f10c-47a6-810e-7a207e235f6e req-27301fa0-f51a-470e-b1c7-4379ca374b64 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] No waiting events found dispatching network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:47:49 user nova-compute[80928]: WARNING nova.compute.manager [req-6d25f948-f10c-47a6-810e-7a207e235f6e req-27301fa0-f51a-470e-b1c7-4379ca374b64 service nova] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Received unexpected event network-vif-plugged-af4426f7-2ac8-4035-98b1-7739d2acf95b for instance with vm_state active and task_state deleting.
Nov 16 05:47:50 user nova-compute[80928]: INFO nova.compute.manager [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Rescuing
Nov 16 05:47:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquired lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:47:50 user nova-compute[80928]: INFO nova.compute.manager [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: a39e1ed9-2651-4de2-8979-c030b02b0ee1] Took 0.82 seconds to detach 1 volumes for instance.
Nov 16 05:47:50 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updating instance_info_cache with network_info: [{"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Releasing lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-772643a2-5854-431e-b945-6e7c43fedb81 req-6ed51503-e2cc-4853-9264-c005c64f5c7c service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-unplugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-772643a2-5854-431e-b945-6e7c43fedb81 req-6ed51503-e2cc-4853-9264-c005c64f5c7c service nova] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-772643a2-5854-431e-b945-6e7c43fedb81 req-6ed51503-e2cc-4853-9264-c005c64f5c7c service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-772643a2-5854-431e-b945-6e7c43fedb81 req-6ed51503-e2cc-4853-9264-c005c64f5c7c service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-772643a2-5854-431e-b945-6e7c43fedb81 req-6ed51503-e2cc-4853-9264-c005c64f5c7c service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] No waiting events found dispatching network-vif-unplugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:47:50 user nova-compute[80928]: WARNING nova.compute.manager [req-772643a2-5854-431e-b945-6e7c43fedb81 req-6ed51503-e2cc-4853-9264-c005c64f5c7c service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received unexpected event network-vif-unplugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 for instance with vm_state active and task_state rescuing.
Nov 16 05:47:50 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:47:50 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:51 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Deleted allocations for instance a39e1ed9-2651-4de2-8979-c030b02b0ee1
Nov 16 05:47:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-28e155cd-e05c-4599-942f-ee45570475a8 tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "a39e1ed9-2651-4de2-8979-c030b02b0ee1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.689s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:51 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Instance destroyed successfully.
Nov 16 05:47:51 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Attempting rescue
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=80928) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Instance directory exists: not creating {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 05:47:51 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Creating image(s)
Nov 16 05:47:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "/opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "/opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "/opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'trusted_certs' on Instance uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.rescue {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.rescue" returned: 0 in 0.049s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'migration_context' on Instance uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.objects.base [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<f38bf2ae-3719-400f-9da0-dcfade8c6fd7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Start _get_guest_xml network_info=[{"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "vif_mac": "fa:16:3e:b2:65:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'resources' on Instance uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.objects.base [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<f38bf2ae-3719-400f-9da0-dcfade8c6fd7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'numa_topology' on Instance uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.objects.base [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<f38bf2ae-3719-400f-9da0-dcfade8c6fd7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:47:51 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:47:51 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'vcpu_model' on Instance uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.objects.base [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<f38bf2ae-3719-400f-9da0-dcfade8c6fd7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-862455296',display_name='tempest-ServerRescueNegativeTestJSON-server-862455296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-862455296',id=35,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkw5iCaKuOS7IO2Sp9Heoc9mgZtHIGvE/j7xHdnGD10/NqBa38q9r3At6EKN4fK/8sUZl11uX5NLPj1Y3OV/R6Md0dVYQok4USN7TvyvaboDEqgtO3EVj0eWlt2HqmVCg==',key_name='tempest-keypair-984127359',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:45:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8820092d2a4d50ab092ac90e5e1d3d',ramdisk_id='',reservation_id='r-9c1an6p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-575506684',owner_user_name='tempest-ServerRescueNegativeTestJSON-575506684-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:45:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ade947942acc48ef940224970f670985',uuid=f38bf2ae-3719-400f-9da0-dcfade8c6fd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "vif_mac": "fa:16:3e:b2:65:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converting VIF {"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "vif_mac": "fa:16:3e:b2:65:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:65:29,bridge_name='br-int',has_traffic_filtering=True,id=d5c7e129-4809-463e-b3c9-5091f165e8c5,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c7e129-48') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'pci_devices' on Instance uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.objects.base [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Object Instance<f38bf2ae-3719-400f-9da0-dcfade8c6fd7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:47:51 user nova-compute[80928]:   <uuid>f38bf2ae-3719-400f-9da0-dcfade8c6fd7</uuid>
Nov 16 05:47:51 user nova-compute[80928]:   <name>instance-00000023</name>
Nov 16 05:47:51 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:47:51 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:47:51 user nova-compute[80928]:   <metadata>
Nov 16 05:47:51 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:47:51 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:47:51 user nova-compute[80928]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-862455296</nova:name>
Nov 16 05:47:51 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:47:51</nova:creationTime>
Nov 16 05:47:51 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:47:51 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:47:51 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:47:51 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:47:51 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:47:51 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:47:51 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:47:51 user nova-compute[80928]:       <nova:owner>
Nov 16 05:47:51 user nova-compute[80928]:         <nova:user uuid="ade947942acc48ef940224970f670985">tempest-ServerRescueNegativeTestJSON-575506684-project-member</nova:user>
Nov 16 05:47:51 user nova-compute[80928]:         <nova:project uuid="bf8820092d2a4d50ab092ac90e5e1d3d">tempest-ServerRescueNegativeTestJSON-575506684</nova:project>
Nov 16 05:47:51 user nova-compute[80928]:       </nova:owner>
Nov 16 05:47:51 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:47:51 user nova-compute[80928]:       <nova:ports>
Nov 16 05:47:51 user nova-compute[80928]:         <nova:port uuid="d5c7e129-4809-463e-b3c9-5091f165e8c5">
Nov 16 05:47:51 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 05:47:51 user nova-compute[80928]:         </nova:port>
Nov 16 05:47:51 user nova-compute[80928]:       </nova:ports>
Nov 16 05:47:51 user nova-compute[80928]:     </nova:instance>
Nov 16 05:47:51 user nova-compute[80928]:   </metadata>
Nov 16 05:47:51 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:47:51 user nova-compute[80928]:     <system>
Nov 16 05:47:51 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:47:51 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:47:51 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:47:51 user nova-compute[80928]:       <entry name="serial">f38bf2ae-3719-400f-9da0-dcfade8c6fd7</entry>
Nov 16 05:47:51 user nova-compute[80928]:       <entry name="uuid">f38bf2ae-3719-400f-9da0-dcfade8c6fd7</entry>
Nov 16 05:47:51 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:47:51 user nova-compute[80928]:     </system>
Nov 16 05:47:51 user nova-compute[80928]:   </sysinfo>
Nov 16 05:47:51 user nova-compute[80928]:   <os>
Nov 16 05:47:51 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:47:51 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:47:51 user nova-compute[80928]:   </os>
Nov 16 05:47:51 user nova-compute[80928]:   <features>
Nov 16 05:47:51 user nova-compute[80928]:     <acpi/>
Nov 16 05:47:51 user nova-compute[80928]:     <apic/>
Nov 16 05:47:51 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:47:51 user nova-compute[80928]:   </features>
Nov 16 05:47:51 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:47:51 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:47:51 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:47:51 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:47:51 user nova-compute[80928]:   </clock>
Nov 16 05:47:51 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:47:51 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:47:51 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:47:51 user nova-compute[80928]:   </cpu>
Nov 16 05:47:51 user nova-compute[80928]:   <devices>
Nov 16 05:47:51 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:47:51 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:47:51 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.rescue"/>
Nov 16 05:47:51 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:47:51 user nova-compute[80928]:     </disk>
Nov 16 05:47:51 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:47:51 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:47:51 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk"/>
Nov 16 05:47:51 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:47:51 user nova-compute[80928]:     </disk>
Nov 16 05:47:51 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:47:51 user nova-compute[80928]:       <mac address="fa:16:3e:b2:65:29"/>
Nov 16 05:47:51 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:47:51 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:47:51 user nova-compute[80928]:       <target dev="tapd5c7e129-48"/>
Nov 16 05:47:51 user nova-compute[80928]:     </interface>
Nov 16 05:47:51 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:47:51 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/console.log" append="off"/>
Nov 16 05:47:51 user nova-compute[80928]:     </serial>
Nov 16 05:47:51 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:47:51 user nova-compute[80928]:     <video>
Nov 16 05:47:51 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:47:51 user nova-compute[80928]:     </video>
Nov 16 05:47:51 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:47:51 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:47:51 user nova-compute[80928]:     </rng>
Nov 16 05:47:51 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:47:51 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:47:51 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:47:51 user nova-compute[80928]:     </memballoon>
Nov 16 05:47:51 user nova-compute[80928]:   </devices>
Nov 16 05:47:51 user nova-compute[80928]: </domain>
Nov 16 05:47:51 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:47:51 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Instance destroyed successfully.
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:47:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] No VIF found with MAC fa:16:3e:b2:65:29, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:47:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-00299598-6478-4eed-a77a-8ffda8d1c2a3 req-7c787e89-4c23-4648-9676-86528040cc00 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-00299598-6478-4eed-a77a-8ffda8d1c2a3 req-7c787e89-4c23-4648-9676-86528040cc00 service nova] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-00299598-6478-4eed-a77a-8ffda8d1c2a3 req-7c787e89-4c23-4648-9676-86528040cc00 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-00299598-6478-4eed-a77a-8ffda8d1c2a3 req-7c787e89-4c23-4648-9676-86528040cc00 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-00299598-6478-4eed-a77a-8ffda8d1c2a3 req-7c787e89-4c23-4648-9676-86528040cc00 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] No waiting events found dispatching network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:47:52 user nova-compute[80928]: WARNING nova.compute.manager [req-00299598-6478-4eed-a77a-8ffda8d1c2a3 req-7c787e89-4c23-4648-9676-86528040cc00 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received unexpected event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 for instance with vm_state active and task_state rescuing.
Nov 16 05:47:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-0a86dbd8-0a88-48f5-bc7a-e77742b0949a req-b81c981b-201c-4afd-80f1-fe021898fc02 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0a86dbd8-0a88-48f5-bc7a-e77742b0949a req-b81c981b-201c-4afd-80f1-fe021898fc02 service nova] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0a86dbd8-0a88-48f5-bc7a-e77742b0949a req-b81c981b-201c-4afd-80f1-fe021898fc02 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0a86dbd8-0a88-48f5-bc7a-e77742b0949a req-b81c981b-201c-4afd-80f1-fe021898fc02 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-0a86dbd8-0a88-48f5-bc7a-e77742b0949a req-b81c981b-201c-4afd-80f1-fe021898fc02 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] No waiting events found dispatching network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:47:55 user nova-compute[80928]: WARNING nova.compute.manager [req-0a86dbd8-0a88-48f5-bc7a-e77742b0949a req-b81c981b-201c-4afd-80f1-fe021898fc02 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received unexpected event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 for instance with vm_state active and task_state rescuing.
Nov 16 05:47:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-0a86dbd8-0a88-48f5-bc7a-e77742b0949a req-b81c981b-201c-4afd-80f1-fe021898fc02 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0a86dbd8-0a88-48f5-bc7a-e77742b0949a req-b81c981b-201c-4afd-80f1-fe021898fc02 service nova] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0a86dbd8-0a88-48f5-bc7a-e77742b0949a req-b81c981b-201c-4afd-80f1-fe021898fc02 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0a86dbd8-0a88-48f5-bc7a-e77742b0949a req-b81c981b-201c-4afd-80f1-fe021898fc02 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-0a86dbd8-0a88-48f5-bc7a-e77742b0949a req-b81c981b-201c-4afd-80f1-fe021898fc02 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] No waiting events found dispatching network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:47:55 user nova-compute[80928]: WARNING nova.compute.manager [req-0a86dbd8-0a88-48f5-bc7a-e77742b0949a req-b81c981b-201c-4afd-80f1-fe021898fc02 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received unexpected event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 for instance with vm_state active and task_state rescuing.
Nov 16 05:47:55 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1b6ba59f-f294-460c-90f7-bd8d5549150f tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:47:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "762caa99-5c4a-428d-8059-7903d0bdb149" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "762caa99-5c4a-428d-8059-7903d0bdb149" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:57 user nova-compute[80928]: INFO nova.compute.manager [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Terminating instance
Nov 16 05:47:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-851d594d-2cf8-40f7-ba74-fdcb1ef9fa1f req-5123b88e-e222-4b34-847f-6ec585b46f7a service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Received event network-vif-unplugged-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-851d594d-2cf8-40f7-ba74-fdcb1ef9fa1f req-5123b88e-e222-4b34-847f-6ec585b46f7a service nova] Acquiring lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-851d594d-2cf8-40f7-ba74-fdcb1ef9fa1f req-5123b88e-e222-4b34-847f-6ec585b46f7a service nova] Lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-851d594d-2cf8-40f7-ba74-fdcb1ef9fa1f req-5123b88e-e222-4b34-847f-6ec585b46f7a service nova] Lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-851d594d-2cf8-40f7-ba74-fdcb1ef9fa1f req-5123b88e-e222-4b34-847f-6ec585b46f7a service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] No waiting events found dispatching network-vif-unplugged-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:47:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-851d594d-2cf8-40f7-ba74-fdcb1ef9fa1f req-5123b88e-e222-4b34-847f-6ec585b46f7a service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Received event network-vif-unplugged-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:47:58 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Instance destroyed successfully.
Nov 16 05:47:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lazy-loading 'resources' on Instance uuid 762caa99-5c4a-428d-8059-7903d0bdb149 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:29:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1416852177',display_name='tempest-ServerActionsTestOtherA-server-1416852177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1416852177',id=4,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIRZfEcvuwNYhj/y1xM6mcxohhx0m8ZHaUgJiSsxMQwSOGLIDwHJFsK0QD5y79ZqmyvT9tlBnMJypgzLM6OAyjdPrnmqxNSLqGp1Mi6dH0+QoZTXMm8gRWHjmecV7kNjw==',key_name='tempest-keypair-1523932878',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9684eff8dae04ceeb858555284d27e39',ramdisk_id='',reservation_id='r-4h235xb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1550926993',owner_user_name='tempest-ServerActionsTestOtherA-1550926993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:29:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1697de2fd04b27bc89ec6430a8a51d',uuid=762caa99-5c4a-428d-8059-7903d0bdb149,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converting VIF {"id": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "address": "fa:16:3e:a7:d7:ea", "network": {"id": "459cfcbb-f7a2-484d-978a-5db552494f24", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-486420499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9684eff8dae04ceeb858555284d27e39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1c448b-9e", "ovs_interfaceid": "9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:d7:ea,bridge_name='br-int',has_traffic_filtering=True,id=9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1c448b-9e') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG os_vif [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:d7:ea,bridge_name='br-int',has_traffic_filtering=True,id=9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1c448b-9e') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a1c448b-9e, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab8b3caf-ee2b-4e14-9186-baea05e009fc) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:47:58 user nova-compute[80928]: INFO os_vif [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:d7:ea,bridge_name='br-int',has_traffic_filtering=True,id=9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd,network=Network(459cfcbb-f7a2-484d-978a-5db552494f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1c448b-9e')
Nov 16 05:47:58 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Deleting instance files /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149_del
Nov 16 05:47:58 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Deletion of /opt/stack/data/nova/instances/762caa99-5c4a-428d-8059-7903d0bdb149_del complete
Nov 16 05:47:58 user nova-compute[80928]: INFO nova.compute.manager [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 16 05:47:58 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:47:58 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Took 0.43 seconds to deallocate network for instance.
Nov 16 05:47:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-700f39d2-a812-4401-b430-014e073888b0 req-dd616b07-c577-41af-9ddf-75eed3ae0ee5 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Received event network-vif-deleted-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:58 user nova-compute[80928]: INFO nova.compute.manager [req-700f39d2-a812-4401-b430-014e073888b0 req-dd616b07-c577-41af-9ddf-75eed3ae0ee5 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Neutron deleted interface 9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd; detaching it from the instance and deleting it from the info cache
Nov 16 05:47:58 user nova-compute[80928]: DEBUG nova.network.neutron [req-700f39d2-a812-4401-b430-014e073888b0 req-dd616b07-c577-41af-9ddf-75eed3ae0ee5 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG nova.compute.manager [req-700f39d2-a812-4401-b430-014e073888b0 req-dd616b07-c577-41af-9ddf-75eed3ae0ee5 service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Detach interface failed, port_id=9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd, reason: Instance 762caa99-5c4a-428d-8059-7903d0bdb149 could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:59 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:47:59 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:47:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:59 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Deleted allocations for instance 762caa99-5c4a-428d-8059-7903d0bdb149
Nov 16 05:47:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ae7cdee6-333b-4ceb-88dc-f35e13a72f02 tempest-ServerActionsTestOtherA-1550926993 tempest-ServerActionsTestOtherA-1550926993-project-member] Lock "762caa99-5c4a-428d-8059-7903d0bdb149" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.878s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-3e7200d9-aeb9-45ab-9574-01a73e2ff563 req-373ac43e-4c9e-4451-89f2-8d4808b113eb service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Received event network-vif-plugged-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:47:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3e7200d9-aeb9-45ab-9574-01a73e2ff563 req-373ac43e-4c9e-4451-89f2-8d4808b113eb service nova] Acquiring lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:47:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3e7200d9-aeb9-45ab-9574-01a73e2ff563 req-373ac43e-4c9e-4451-89f2-8d4808b113eb service nova] Lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:47:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3e7200d9-aeb9-45ab-9574-01a73e2ff563 req-373ac43e-4c9e-4451-89f2-8d4808b113eb service nova] Lock "762caa99-5c4a-428d-8059-7903d0bdb149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:47:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-3e7200d9-aeb9-45ab-9574-01a73e2ff563 req-373ac43e-4c9e-4451-89f2-8d4808b113eb service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] No waiting events found dispatching network-vif-plugged-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:47:59 user nova-compute[80928]: WARNING nova.compute.manager [req-3e7200d9-aeb9-45ab-9574-01a73e2ff563 req-373ac43e-4c9e-4451-89f2-8d4808b113eb service nova] [instance: 762caa99-5c4a-428d-8059-7903d0bdb149] Received unexpected event network-vif-plugged-9a1c448b-9eda-4f65-aaa7-0e64b7e5e1dd for instance with vm_state deleted and task_state None.
Nov 16 05:48:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:03 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:48:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:48:06 user nova-compute[80928]: INFO nova.compute.manager [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] instance snapshotting
Nov 16 05:48:06 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Beginning live snapshot process
Nov 16 05:48:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json -f qcow2 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json -f qcow2 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:06 user nova-compute[80928]: DEBUG nova.objects.instance [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'flavor' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:48:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:07 user nova-compute[80928]: INFO nova.compute.manager [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attaching volume 27e89506-1a17-4351-9b49-3e10a636ab4e to /dev/vdb
Nov 16 05:48:07 user nova-compute[80928]: DEBUG os_brick.utils [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgsu_52bi/14fcbbf01f154c95a70f81d0fe1dc990.delta 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[211eb5fc-52c9-4139-bcab-b4d36ba16535]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgsu_52bi/14fcbbf01f154c95a70f81d0fe1dc990.delta 1073741824" returned: 0 in 0.049s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddcfa83-b867-4d56-9aaa-d8430ffe09ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc85916e-b943-41d1-86bd-e160e248ba9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7ab091-1776-46bf-99ac-c245c4d80116]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:48:07 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1762f58a-d0b9-43f8-933f-648c8f24c2dd]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG os_brick.utils [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Updating existing volume attachment record: 0c9983c0-9bb5-4db8-aa2a-3cb2fe309699 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:48:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:48:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=80928) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 05:48:08 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 05:48:08 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:48:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgsu_52bi/14fcbbf01f154c95a70f81d0fe1dc990.delta /opt/stack/data/nova/instances/snapshots/tmpgsu_52bi/14fcbbf01f154c95a70f81d0fe1dc990 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:08 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:48:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgsu_52bi/14fcbbf01f154c95a70f81d0fe1dc990.delta /opt/stack/data/nova/instances/snapshots/tmpgsu_52bi/14fcbbf01f154c95a70f81d0fe1dc990" returned: 0 in 0.683s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:09 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Snapshot extracted, beginning image upload
Nov 16 05:48:09 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:48:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:48:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:11 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:48:11 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:48:11 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 05:48:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:48:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:48:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:48:11 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 8292134f-09d4-4240-94bb-281e6c236d09 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:48:12 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Snapshot image upload complete
Nov 16 05:48:12 user nova-compute[80928]: INFO nova.compute.manager [None req-a7b349ab-86b6-4746-9f5e-a1e80d0025c2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Took 5.77 seconds to snapshot the instance on the hypervisor.
Nov 16 05:48:12 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Updating instance_info_cache with network_info: [{"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-8292134f-09d4-4240-94bb-281e6c236d09" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'axOgBYEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:48:12 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:48:12 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:48:12 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[be62cbe3-7e7f-4747-b620-75f91537bfa3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:48:12 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f868998a-ada4-4565-a9e1-8d73f18fb612]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e] added
Nov 16 05:48:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7323ead-7144-4a34-82c2-80cc84ad9477]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01c896d-363d-4fe0-8109-bbaa34ae5f07]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v axOgBYEZ {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v axOgBYEZ" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a17bd74-6e54-44b7-a78c-b74c4a14835a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'axOgBYEZ'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e6c5e0-01a8-4114-a2a2-f86dcdf26594]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf011bf5-906b-47de-b198-e28c9caf9cb8]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:48:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:48:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3ee8eb-cc53-4926-9f51-c22c0284c73d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e, portal: 172.16.0.220,3260]
Nov 16 05:48:12 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e, portal: 172.16.0.220,3260] successful.
Nov 16 05:48:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb558a8-864c-4090-bcb2-3b329ed1bf59]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d026557-dde2-4a3c-bb7a-b0e2d27ff569]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:48:12 user nova-compute[80928]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e (non-flash)
Nov 16 05:48:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:48:12 user nova-compute[80928]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e (non-flash)
Nov 16 05:48:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fe5805-f222-44be-af36-c786ae629bcb]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'axOgBYEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:48:12 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:48:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:48:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26633303737303333', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:48:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633303737303333', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:48:13 user nova-compute[80928]: DEBUG nova.objects.instance [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'flavor' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:48:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:48:13 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:48:13 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 05:48:13 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:48:13 user nova-compute[80928]:   <serial>27e89506-1a17-4351-9b49-3e10a636ab4e</serial>
Nov 16 05:48:13 user nova-compute[80928]: </disk>
Nov 16 05:48:13 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No VIF found with MAC fa:16:3e:fa:d8:93, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-10d19135-a369-4d53-91f3-df1c161fd836 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.207s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "98701a69-085d-44f5-8eb0-effd8917f6b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.compute.manager [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:48:14 user nova-compute[80928]: INFO nova.compute.claims [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Claim successful on node user
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.compute.manager [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.compute.manager [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.network.neutron [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:48:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.compute.manager [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:48:14 user nova-compute[80928]: DEBUG nova.policy [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca7c6c355f6045b3b372b280e0f45293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2303337fe174f93801f18cd074276ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:48:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:48:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:48:15 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Creating image(s)
Nov 16 05:48:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "/opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "/opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "/opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "963882eef68b6f42f3caf3eea9ad49d483137ba9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "963882eef68b6f42f3caf3eea9ad49d483137ba9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9.part --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Successfully created port: 4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 1.077s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9.part --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG nova.virt.images [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] 298c8395-8dae-43fd-bc76-63444fc02a1d was qcow2, converting to raw {{(pid=80928) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9.part /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9.converted {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9.part /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9.converted" returned: 0 in 0.823s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:17 user nova-compute[80928]: INFO nova.compute.manager [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Detaching volume 27e89506-1a17-4351-9b49-3e10a636ab4e
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9.converted --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:17 user nova-compute[80928]: INFO nova.virt.block_device [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attempting to driver detach volume 27e89506-1a17-4351-9b49-3e10a636ab4e from mountpoint /dev/vdb
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "963882eef68b6f42f3caf3eea9ad49d483137ba9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.191s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Attempting to detach device vdb from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:48:17 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:48:17 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 05:48:17 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:48:17 user nova-compute[80928]:   <serial>27e89506-1a17-4351-9b49-3e10a636ab4e</serial>
Nov 16 05:48:17 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:48:17 user nova-compute[80928]: </disk>
Nov 16 05:48:17 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Successfully updated port: 4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:48:17 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Successfully detached device vdb from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the persistent domain config.
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:48:17 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:48:17 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 05:48:17 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:48:17 user nova-compute[80928]:   <serial>27e89506-1a17-4351-9b49-3e10a636ab4e</serial>
Nov 16 05:48:17 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:48:17 user nova-compute[80928]: </disk>
Nov 16 05:48:17 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "refresh_cache-98701a69-085d-44f5-8eb0-effd8917f6b5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquired lock "refresh_cache-98701a69-085d-44f5-8eb0-effd8917f6b5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.compute.manager [req-ce943632-3a6c-43e1-94bc-136ed84eac19 req-9f8ec87e-75df-41b5-9280-ea7f1f2737ab service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Received event network-changed-4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.compute.manager [req-ce943632-3a6c-43e1-94bc-136ed84eac19 req-9f8ec87e-75df-41b5-9280-ea7f1f2737ab service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Refreshing instance network info cache due to event network-changed-4e39500a-73df-4081-923c-e7e8913ee64c. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ce943632-3a6c-43e1-94bc-136ed84eac19 req-9f8ec87e-75df-41b5-9280-ea7f1f2737ab service nova] Acquiring lock "refresh_cache-98701a69-085d-44f5-8eb0-effd8917f6b5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9 --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "963882eef68b6f42f3caf3eea9ad49d483137ba9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "963882eef68b6f42f3caf3eea9ad49d483137ba9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9 --force-share --output=json" returned: 0 in 0.203s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9,backing_fmt=raw /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9,backing_fmt=raw /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk 1073741824" returned: 0 in 0.101s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "963882eef68b6f42f3caf3eea9ad49d483137ba9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Updating instance_info_cache with network_info: [{"id": "4e39500a-73df-4081-923c-e7e8913ee64c", "address": "fa:16:3e:50:29:ec", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39500a-73", "ovs_interfaceid": "4e39500a-73df-4081-923c-e7e8913ee64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Releasing lock "refresh_cache-98701a69-085d-44f5-8eb0-effd8917f6b5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Instance network_info: |[{"id": "4e39500a-73df-4081-923c-e7e8913ee64c", "address": "fa:16:3e:50:29:ec", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39500a-73", "ovs_interfaceid": "4e39500a-73df-4081-923c-e7e8913ee64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ce943632-3a6c-43e1-94bc-136ed84eac19 req-9f8ec87e-75df-41b5-9280-ea7f1f2737ab service nova] Acquired lock "refresh_cache-98701a69-085d-44f5-8eb0-effd8917f6b5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.network.neutron [req-ce943632-3a6c-43e1-94bc-136ed84eac19 req-9f8ec87e-75df-41b5-9280-ea7f1f2737ab service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Refreshing network info cache for port 4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9 --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Ensure instance console log exists: /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Start _get_guest_xml network_info=[{"id": "4e39500a-73df-4081-923c-e7e8913ee64c", "address": "fa:16:3e:50:29:ec", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39500a-73", "ovs_interfaceid": "4e39500a-73df-4081-923c-e7e8913ee64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e554297be22dd5b4f87bc92203121322',container_format='bare',created_at=2023-11-16T05:48:06Z,direct_url=<?>,disk_format='qcow2',id=298c8395-8dae-43fd-bc76-63444fc02a1d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-885815541',owner='e2303337fe174f93801f18cd074276ce',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T05:48:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '298c8395-8dae-43fd-bc76-63444fc02a1d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:48:17 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:48:17 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e554297be22dd5b4f87bc92203121322',container_format='bare',created_at=2023-11-16T05:48:06Z,direct_url=<?>,disk_format='qcow2',id=298c8395-8dae-43fd-bc76-63444fc02a1d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-885815541',owner='e2303337fe174f93801f18cd074276ce',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T05:48:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:48:17 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-678350903',display_name='tempest-TestStampPattern-server-678350903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-678350903',id=37,image_ref='298c8395-8dae-43fd-bc76-63444fc02a1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLePRgjoHIwwFRskFVbkQTWicFJVZFVV6bqATDh63kS8WDDVk64Iwjsbx3COtxGzWdYj0GjKmGqFYJIuK4jxb9Hg6TfWNymS23NQpVvyf/ukUCfHQ63gwGXdG4hy01fL/A==',key_name='tempest-TestStampPattern-637785610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2303337fe174f93801f18cd074276ce',ramdisk_id='',reservation_id='r-dlvxw6jp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6cc61915-ab05-4f3c-80ff-b873ae3dc68a',image_min_disk='1',image_min_ram='0',image_owner_id='e2303337fe174f93801f18cd074276ce',image_owner_project_name='tempest-TestStampPattern-1909880958',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1909880958-project-member',image_user_id='ca7c6c355f6045b3b372b280e0f45293',network_allocated='True',owner_project_name='tempest-TestStampPattern-1909880958',owner_user_name='tempest-TestStampPattern-1909880958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:48:15Z,user_data=None,user_id='ca7c6c355f6045b3b372b280e0f45293',uuid=98701a69-085d-44f5-8eb0-effd8917f6b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e39500a-73df-4081-923c-e7e8913ee64c", "address": "fa:16:3e:50:29:ec", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39500a-73", "ovs_interfaceid": "4e39500a-73df-4081-923c-e7e8913ee64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Converting VIF {"id": "4e39500a-73df-4081-923c-e7e8913ee64c", "address": "fa:16:3e:50:29:ec", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39500a-73", "ovs_interfaceid": "4e39500a-73df-4081-923c-e7e8913ee64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e39500a-73df-4081-923c-e7e8913ee64c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39500a-73') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.objects.instance [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lazy-loading 'pci_devices' on Instance uuid 98701a69-085d-44f5-8eb0-effd8917f6b5 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:48:18 user nova-compute[80928]:   <uuid>98701a69-085d-44f5-8eb0-effd8917f6b5</uuid>
Nov 16 05:48:18 user nova-compute[80928]:   <name>instance-00000025</name>
Nov 16 05:48:18 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:48:18 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:48:18 user nova-compute[80928]:   <metadata>
Nov 16 05:48:18 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:48:18 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:48:18 user nova-compute[80928]:       <nova:name>tempest-TestStampPattern-server-678350903</nova:name>
Nov 16 05:48:18 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:48:17</nova:creationTime>
Nov 16 05:48:18 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:48:18 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:48:18 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:48:18 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:48:18 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:48:18 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:48:18 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:48:18 user nova-compute[80928]:       <nova:owner>
Nov 16 05:48:18 user nova-compute[80928]:         <nova:user uuid="ca7c6c355f6045b3b372b280e0f45293">tempest-TestStampPattern-1909880958-project-member</nova:user>
Nov 16 05:48:18 user nova-compute[80928]:         <nova:project uuid="e2303337fe174f93801f18cd074276ce">tempest-TestStampPattern-1909880958</nova:project>
Nov 16 05:48:18 user nova-compute[80928]:       </nova:owner>
Nov 16 05:48:18 user nova-compute[80928]:       <nova:root type="image" uuid="298c8395-8dae-43fd-bc76-63444fc02a1d"/>
Nov 16 05:48:18 user nova-compute[80928]:       <nova:ports>
Nov 16 05:48:18 user nova-compute[80928]:         <nova:port uuid="4e39500a-73df-4081-923c-e7e8913ee64c">
Nov 16 05:48:18 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:48:18 user nova-compute[80928]:         </nova:port>
Nov 16 05:48:18 user nova-compute[80928]:       </nova:ports>
Nov 16 05:48:18 user nova-compute[80928]:     </nova:instance>
Nov 16 05:48:18 user nova-compute[80928]:   </metadata>
Nov 16 05:48:18 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:48:18 user nova-compute[80928]:     <system>
Nov 16 05:48:18 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:48:18 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:48:18 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:48:18 user nova-compute[80928]:       <entry name="serial">98701a69-085d-44f5-8eb0-effd8917f6b5</entry>
Nov 16 05:48:18 user nova-compute[80928]:       <entry name="uuid">98701a69-085d-44f5-8eb0-effd8917f6b5</entry>
Nov 16 05:48:18 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:48:18 user nova-compute[80928]:     </system>
Nov 16 05:48:18 user nova-compute[80928]:   </sysinfo>
Nov 16 05:48:18 user nova-compute[80928]:   <os>
Nov 16 05:48:18 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:48:18 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:48:18 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:48:18 user nova-compute[80928]:   </os>
Nov 16 05:48:18 user nova-compute[80928]:   <features>
Nov 16 05:48:18 user nova-compute[80928]:     <acpi/>
Nov 16 05:48:18 user nova-compute[80928]:     <apic/>
Nov 16 05:48:18 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:48:18 user nova-compute[80928]:   </features>
Nov 16 05:48:18 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:48:18 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:48:18 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:48:18 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:48:18 user nova-compute[80928]:   </clock>
Nov 16 05:48:18 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:48:18 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:48:18 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:48:18 user nova-compute[80928]:   </cpu>
Nov 16 05:48:18 user nova-compute[80928]:   <devices>
Nov 16 05:48:18 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:48:18 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:48:18 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk"/>
Nov 16 05:48:18 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:48:18 user nova-compute[80928]:     </disk>
Nov 16 05:48:18 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:48:18 user nova-compute[80928]:       <mac address="fa:16:3e:50:29:ec"/>
Nov 16 05:48:18 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:48:18 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:48:18 user nova-compute[80928]:       <target dev="tap4e39500a-73"/>
Nov 16 05:48:18 user nova-compute[80928]:     </interface>
Nov 16 05:48:18 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:48:18 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/console.log" append="off"/>
Nov 16 05:48:18 user nova-compute[80928]:     </serial>
Nov 16 05:48:18 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:48:18 user nova-compute[80928]:     <video>
Nov 16 05:48:18 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:48:18 user nova-compute[80928]:     </video>
Nov 16 05:48:18 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:48:18 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:48:18 user nova-compute[80928]:     </rng>
Nov 16 05:48:18 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:48:18 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:48:18 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:48:18 user nova-compute[80928]:     </memballoon>
Nov 16 05:48:18 user nova-compute[80928]:   </devices>
Nov 16 05:48:18 user nova-compute[80928]: </domain>
Nov 16 05:48:18 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-678350903',display_name='tempest-TestStampPattern-server-678350903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-678350903',id=37,image_ref='298c8395-8dae-43fd-bc76-63444fc02a1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLePRgjoHIwwFRskFVbkQTWicFJVZFVV6bqATDh63kS8WDDVk64Iwjsbx3COtxGzWdYj0GjKmGqFYJIuK4jxb9Hg6TfWNymS23NQpVvyf/ukUCfHQ63gwGXdG4hy01fL/A==',key_name='tempest-TestStampPattern-637785610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2303337fe174f93801f18cd074276ce',ramdisk_id='',reservation_id='r-dlvxw6jp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6cc61915-ab05-4f3c-80ff-b873ae3dc68a',image_min_disk='1',image_min_ram='0',image_owner_id='e2303337fe174f93801f18cd074276ce',image_owner_project_name='tempest-TestStampPattern-1909880958',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1909880958-project-member',image_user_id='ca7c6c355f6045b3b372b280e0f45293',network_allocated='True',owner_project_name='tempest-TestStampPattern-1909880958',owner_user_name='tempest-TestStampPattern-1909880958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:48:15Z,user_data=None,user_id='ca7c6c355f6045b3b372b280e0f45293',uuid=98701a69-085d-44f5-8eb0-effd8917f6b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e39500a-73df-4081-923c-e7e8913ee64c", "address": "fa:16:3e:50:29:ec", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39500a-73", "ovs_interfaceid": "4e39500a-73df-4081-923c-e7e8913ee64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Converting VIF {"id": "4e39500a-73df-4081-923c-e7e8913ee64c", "address": "fa:16:3e:50:29:ec", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39500a-73", "ovs_interfaceid": "4e39500a-73df-4081-923c-e7e8913ee64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e39500a-73df-4081-923c-e7e8913ee64c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39500a-73') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG os_vif [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e39500a-73df-4081-923c-e7e8913ee64c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39500a-73') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64db038f-e942-5c9e-917d-fb3e537477af', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e39500a-73, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e39500a-73, col_values=(('qos', UUID('f64e9daa-9eae-4da8-b8e1-15599311a1c2')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e39500a-73, col_values=(('external_ids', {'iface-id': '4e39500a-73df-4081-923c-e7e8913ee64c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:29:ec', 'vm-uuid': '98701a69-085d-44f5-8eb0-effd8917f6b5'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:18 user nova-compute[80928]: INFO os_vif [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e39500a-73df-4081-923c-e7e8913ee64c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39500a-73')
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] No VIF found with MAC fa:16:3e:50:29:ec, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.network.neutron [req-ce943632-3a6c-43e1-94bc-136ed84eac19 req-9f8ec87e-75df-41b5-9280-ea7f1f2737ab service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Updated VIF entry in instance network info cache for port 4e39500a-73df-4081-923c-e7e8913ee64c. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.network.neutron [req-ce943632-3a6c-43e1-94bc-136ed84eac19 req-9f8ec87e-75df-41b5-9280-ea7f1f2737ab service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Updating instance_info_cache with network_info: [{"id": "4e39500a-73df-4081-923c-e7e8913ee64c", "address": "fa:16:3e:50:29:ec", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39500a-73", "ovs_interfaceid": "4e39500a-73df-4081-923c-e7e8913ee64c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ce943632-3a6c-43e1-94bc-136ed84eac19 req-9f8ec87e-75df-41b5-9280-ea7f1f2737ab service nova] Releasing lock "refresh_cache-98701a69-085d-44f5-8eb0-effd8917f6b5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG nova.compute.manager [req-e5209b7b-2300-4cc1-8375-661980a877f9 req-67eba260-bb11-4d78-b3d5-17b7bb1d2b83 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Received event network-vif-plugged-4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e5209b7b-2300-4cc1-8375-661980a877f9 req-67eba260-bb11-4d78-b3d5-17b7bb1d2b83 service nova] Acquiring lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e5209b7b-2300-4cc1-8375-661980a877f9 req-67eba260-bb11-4d78-b3d5-17b7bb1d2b83 service nova] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e5209b7b-2300-4cc1-8375-661980a877f9 req-67eba260-bb11-4d78-b3d5-17b7bb1d2b83 service nova] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG nova.compute.manager [req-e5209b7b-2300-4cc1-8375-661980a877f9 req-67eba260-bb11-4d78-b3d5-17b7bb1d2b83 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] No waiting events found dispatching network-vif-plugged-4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:48:21 user nova-compute[80928]: WARNING nova.compute.manager [req-e5209b7b-2300-4cc1-8375-661980a877f9 req-67eba260-bb11-4d78-b3d5-17b7bb1d2b83 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Received unexpected event network-vif-plugged-4e39500a-73df-4081-923c-e7e8913ee64c for instance with vm_state building and task_state spawning.
Nov 16 05:48:21 user nova-compute[80928]: DEBUG nova.compute.manager [req-23336ede-aeda-42dc-addc-49ab8ce6cc52 req-5b407cbb-a869-4034-9a21-bfec8eb17946 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Received event network-vif-plugged-4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-23336ede-aeda-42dc-addc-49ab8ce6cc52 req-5b407cbb-a869-4034-9a21-bfec8eb17946 service nova] Acquiring lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-23336ede-aeda-42dc-addc-49ab8ce6cc52 req-5b407cbb-a869-4034-9a21-bfec8eb17946 service nova] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-23336ede-aeda-42dc-addc-49ab8ce6cc52 req-5b407cbb-a869-4034-9a21-bfec8eb17946 service nova] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG nova.compute.manager [req-23336ede-aeda-42dc-addc-49ab8ce6cc52 req-5b407cbb-a869-4034-9a21-bfec8eb17946 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] No waiting events found dispatching network-vif-plugged-4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:48:21 user nova-compute[80928]: WARNING nova.compute.manager [req-23336ede-aeda-42dc-addc-49ab8ce6cc52 req-5b407cbb-a869-4034-9a21-bfec8eb17946 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Received unexpected event network-vif-plugged-4e39500a-73df-4081-923c-e7e8913ee64c for instance with vm_state building and task_state spawning.
Nov 16 05:48:21 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Instance spawned successfully.
Nov 16 05:48:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:48:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:48:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7943MB free_disk=25.136165618896484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:48:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:48:22 user nova-compute[80928]: INFO nova.compute.manager [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8292134f-09d4-4240-94bb-281e6c236d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance e6ff1633-6efc-4953-94c0-37dfca5eb077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 98701a69-085d-44f5-8eb0-effd8917f6b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:48:22 user nova-compute[80928]: INFO nova.compute.manager [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Took 7.91 seconds to build instance.
Nov 16 05:48:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-66f4848c-7d42-4c63-8b77-bc3fd523fef7 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.014s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:48:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:25 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:48:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:48:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:37 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af is timed out.
Nov 16 05:48:37 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Successfully detached device vdb from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the live domain config.
Nov 16 05:48:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'axOgBYEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:48:37 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea83a3d1-9363-4d1a-ab52-5284f2579672]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:48:37 user nova-compute[80928]: No targets found.
Nov 16 05:48:37 user nova-compute[80928]: iSNS:
Nov 16 05:48:37 user nova-compute[80928]: No targets found.
Nov 16 05:48:37 user nova-compute[80928]: STATIC:
Nov 16 05:48:37 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a
Nov 16 05:48:37 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:48:37 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:48:37 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e
Nov 16 05:48:37 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:48:37 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:48:37 user nova-compute[80928]: FIRMWARE:
Nov 16 05:48:37 user nova-compute[80928]: No targets found.
Nov 16 05:48:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:48:37 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:48:37 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1073c86a-5080-492a-bd64-86e318678b38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ca48e7-d6c4-49a5-a475-5a7d71c4e214]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:48:37 user nova-compute[80928]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e (non-flash)
Nov 16 05:48:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:48:37 user nova-compute[80928]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e (non-flash)
Nov 16 05:48:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f868999f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1350d07-4b3f-4d06-8084-bfadb7595a9f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[efef3a67-eb22-4f2c-ac1c-c5d5c10a59cc]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd2dae0-93a4-4098-957c-02e8e6885f24]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb8b816-b2c9-4164-90e6-53b2077fb707]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:48:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b572770-c20d-42f6-908c-b600e82ec985]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[abec2c79-33b8-4cdd-8137-c8f9c83a14d7]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e, portal: 172.16.0.220,3260]
Nov 16 05:48:38 user nova-compute[80928]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e, portal: 172.16.0.220,3260] successful.
Nov 16 05:48:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e89506-1a17-4351-9b49-3e10a636ab4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e06b4e3-dac4-444f-9cda-661f0617d60c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] <== disconnect_volume: return (272ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "8292134f-09d4-4240-94bb-281e6c236d09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "8292134f-09d4-4240-94bb-281e6c236d09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "8292134f-09d4-4240-94bb-281e6c236d09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "8292134f-09d4-4240-94bb-281e6c236d09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "8292134f-09d4-4240-94bb-281e6c236d09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:38 user nova-compute[80928]: INFO nova.compute.manager [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Terminating instance
Nov 16 05:48:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-7d2e9833-0028-479b-94ef-75903917e649 req-76e4de26-f8ba-4a12-92b6-fbf3c0438ede service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Received event network-vif-unplugged-b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7d2e9833-0028-479b-94ef-75903917e649 req-76e4de26-f8ba-4a12-92b6-fbf3c0438ede service nova] Acquiring lock "8292134f-09d4-4240-94bb-281e6c236d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7d2e9833-0028-479b-94ef-75903917e649 req-76e4de26-f8ba-4a12-92b6-fbf3c0438ede service nova] Lock "8292134f-09d4-4240-94bb-281e6c236d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7d2e9833-0028-479b-94ef-75903917e649 req-76e4de26-f8ba-4a12-92b6-fbf3c0438ede service nova] Lock "8292134f-09d4-4240-94bb-281e6c236d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-7d2e9833-0028-479b-94ef-75903917e649 req-76e4de26-f8ba-4a12-92b6-fbf3c0438ede service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] No waiting events found dispatching network-vif-unplugged-b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-7d2e9833-0028-479b-94ef-75903917e649 req-76e4de26-f8ba-4a12-92b6-fbf3c0438ede service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Received event network-vif-unplugged-b4c13900-ad26-495d-b3e6-c791298f31fd for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG nova.objects.instance [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'flavor' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:48:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6fc98c0d-1a76-4161-b466-60e822e1988b tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.911s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:39 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Instance destroyed successfully.
Nov 16 05:48:39 user nova-compute[80928]: DEBUG nova.objects.instance [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lazy-loading 'resources' on Instance uuid 8292134f-09d4-4240-94bb-281e6c236d09 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1619627102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1619627102',id=1,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='995121e71e234f60b7f7d5ac0abcc0f1',ramdisk_id='',reservation_id='r-46kx7cjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:30:54Z,user_data=None,user_id='3bb9af29de44488282666171f2bcad47',uuid=8292134f-09d4-4240-94bb-281e6c236d09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converting VIF {"id": "b4c13900-ad26-495d-b3e6-c791298f31fd", "address": "fa:16:3e:6c:76:b1", "network": {"id": "95689f94-0da6-4466-b89d-32dc7b030b48", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-819846811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995121e71e234f60b7f7d5ac0abcc0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4c13900-ad", "ovs_interfaceid": "b4c13900-ad26-495d-b3e6-c791298f31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:76:b1,bridge_name='br-int',has_traffic_filtering=True,id=b4c13900-ad26-495d-b3e6-c791298f31fd,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c13900-ad') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG os_vif [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:76:b1,bridge_name='br-int',has_traffic_filtering=True,id=b4c13900-ad26-495d-b3e6-c791298f31fd,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c13900-ad') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4c13900-ad, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96d0c028-e58e-48b7-9028-7369410182be) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:48:39 user nova-compute[80928]: INFO os_vif [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:76:b1,bridge_name='br-int',has_traffic_filtering=True,id=b4c13900-ad26-495d-b3e6-c791298f31fd,network=Network(95689f94-0da6-4466-b89d-32dc7b030b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4c13900-ad')
Nov 16 05:48:39 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Deleting instance files /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09_del
Nov 16 05:48:39 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Deletion of /opt/stack/data/nova/instances/8292134f-09d4-4240-94bb-281e6c236d09_del complete
Nov 16 05:48:39 user nova-compute[80928]: INFO nova.compute.manager [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 05:48:39 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:48:39 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Took 0.50 seconds to deallocate network for instance.
Nov 16 05:48:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:48:39 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:48:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:40 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Deleted allocations for instance 8292134f-09d4-4240-94bb-281e6c236d09
Nov 16 05:48:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-15556d56-8db6-450c-991a-28d7162a919d tempest-ServerBootFromVolumeStableRescueTest-1026359285 tempest-ServerBootFromVolumeStableRescueTest-1026359285-project-member] Lock "8292134f-09d4-4240-94bb-281e6c236d09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-2698f164-506d-42a0-b125-611cb0f7d871 req-46383fee-24ea-4778-9c53-67304c024d2f service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Received event network-vif-plugged-b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:48:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2698f164-506d-42a0-b125-611cb0f7d871 req-46383fee-24ea-4778-9c53-67304c024d2f service nova] Acquiring lock "8292134f-09d4-4240-94bb-281e6c236d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:48:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2698f164-506d-42a0-b125-611cb0f7d871 req-46383fee-24ea-4778-9c53-67304c024d2f service nova] Lock "8292134f-09d4-4240-94bb-281e6c236d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:48:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2698f164-506d-42a0-b125-611cb0f7d871 req-46383fee-24ea-4778-9c53-67304c024d2f service nova] Lock "8292134f-09d4-4240-94bb-281e6c236d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:48:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-2698f164-506d-42a0-b125-611cb0f7d871 req-46383fee-24ea-4778-9c53-67304c024d2f service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] No waiting events found dispatching network-vif-plugged-b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:48:40 user nova-compute[80928]: WARNING nova.compute.manager [req-2698f164-506d-42a0-b125-611cb0f7d871 req-46383fee-24ea-4778-9c53-67304c024d2f service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Received unexpected event network-vif-plugged-b4c13900-ad26-495d-b3e6-c791298f31fd for instance with vm_state deleted and task_state None.
Nov 16 05:48:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-2698f164-506d-42a0-b125-611cb0f7d871 req-46383fee-24ea-4778-9c53-67304c024d2f service nova] [instance: 8292134f-09d4-4240-94bb-281e6c236d09] Received event network-vif-deleted-b4c13900-ad26-495d-b3e6-c791298f31fd {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:48:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:48:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:49:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:49:00 user nova-compute[80928]: INFO nova.compute.claims [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Claim successful on node user
Nov 16 05:49:00 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:49:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:49:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG nova.network.neutron [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:49:01 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:49:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG nova.policy [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be30aca2412b475498f99dddb86c5983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6e74da88a497ca920dcb2e07ea05a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:49:01 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Creating image(s)
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "/opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "/opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "/opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.166s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk 1073741824" returned: 0 in 0.054s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG nova.network.neutron [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Successfully created port: 7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Cannot resize image /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Ensure instance console log exists: /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Successfully updated port: 7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquired lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-71008bac-3adb-42bf-a9fd-754c8731b07f req-d8cafe3d-ab6e-4af8-946e-3f2657960440 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-changed-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-71008bac-3adb-42bf-a9fd-754c8731b07f req-d8cafe3d-ab6e-4af8-946e-3f2657960440 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Refreshing instance network info cache due to event network-changed-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-71008bac-3adb-42bf-a9fd-754c8731b07f req-d8cafe3d-ab6e-4af8-946e-3f2657960440 service nova] Acquiring lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updating instance_info_cache with network_info: [{"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Releasing lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance network_info: |[{"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-71008bac-3adb-42bf-a9fd-754c8731b07f req-d8cafe3d-ab6e-4af8-946e-3f2657960440 service nova] Acquired lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.network.neutron [req-71008bac-3adb-42bf-a9fd-754c8731b07f req-d8cafe3d-ab6e-4af8-946e-3f2657960440 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Refreshing network info cache for port 7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Start _get_guest_xml network_info=[{"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:49:02 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:49:02 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1608335381',display_name='tempest-AttachVolumeTestJSON-server-1608335381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1608335381',id=38,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIheiaIxPwP6SA4L1FNfT/iVP2oIcKbZWevRs6N7x4qvsfqzxVVfO6fF8zGk5rw0ndDEv99BxFLQjD1+Tt+oqfeijNH8TrsvSWOfBX1YC4BXEZkch1QPW+6pCo5Kkt1+w==',key_name='tempest-keypair-845255928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05d6e74da88a497ca920dcb2e07ea05a',ramdisk_id='',reservation_id='r-yk964sbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1530907565',owner_user_name='tempest-AttachVolumeTestJSON-1530907565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be30aca2412b475498f99dddb86c5983',uuid=35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converting VIF {"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.objects.instance [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'pci_devices' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:49:02 user nova-compute[80928]:   <uuid>35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7</uuid>
Nov 16 05:49:02 user nova-compute[80928]:   <name>instance-00000026</name>
Nov 16 05:49:02 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:49:02 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:49:02 user nova-compute[80928]:   <metadata>
Nov 16 05:49:02 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:49:02 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:49:02 user nova-compute[80928]:       <nova:name>tempest-AttachVolumeTestJSON-server-1608335381</nova:name>
Nov 16 05:49:02 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:49:02</nova:creationTime>
Nov 16 05:49:02 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:49:02 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:49:02 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:49:02 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:49:02 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:49:02 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:49:02 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:49:02 user nova-compute[80928]:       <nova:owner>
Nov 16 05:49:02 user nova-compute[80928]:         <nova:user uuid="be30aca2412b475498f99dddb86c5983">tempest-AttachVolumeTestJSON-1530907565-project-member</nova:user>
Nov 16 05:49:02 user nova-compute[80928]:         <nova:project uuid="05d6e74da88a497ca920dcb2e07ea05a">tempest-AttachVolumeTestJSON-1530907565</nova:project>
Nov 16 05:49:02 user nova-compute[80928]:       </nova:owner>
Nov 16 05:49:02 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:49:02 user nova-compute[80928]:       <nova:ports>
Nov 16 05:49:02 user nova-compute[80928]:         <nova:port uuid="7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5">
Nov 16 05:49:02 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 05:49:02 user nova-compute[80928]:         </nova:port>
Nov 16 05:49:02 user nova-compute[80928]:       </nova:ports>
Nov 16 05:49:02 user nova-compute[80928]:     </nova:instance>
Nov 16 05:49:02 user nova-compute[80928]:   </metadata>
Nov 16 05:49:02 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:49:02 user nova-compute[80928]:     <system>
Nov 16 05:49:02 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:49:02 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:49:02 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:49:02 user nova-compute[80928]:       <entry name="serial">35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7</entry>
Nov 16 05:49:02 user nova-compute[80928]:       <entry name="uuid">35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7</entry>
Nov 16 05:49:02 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:49:02 user nova-compute[80928]:     </system>
Nov 16 05:49:02 user nova-compute[80928]:   </sysinfo>
Nov 16 05:49:02 user nova-compute[80928]:   <os>
Nov 16 05:49:02 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:49:02 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:49:02 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:49:02 user nova-compute[80928]:   </os>
Nov 16 05:49:02 user nova-compute[80928]:   <features>
Nov 16 05:49:02 user nova-compute[80928]:     <acpi/>
Nov 16 05:49:02 user nova-compute[80928]:     <apic/>
Nov 16 05:49:02 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:49:02 user nova-compute[80928]:   </features>
Nov 16 05:49:02 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:49:02 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:49:02 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:49:02 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:49:02 user nova-compute[80928]:   </clock>
Nov 16 05:49:02 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:49:02 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:49:02 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:49:02 user nova-compute[80928]:   </cpu>
Nov 16 05:49:02 user nova-compute[80928]:   <devices>
Nov 16 05:49:02 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:49:02 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:49:02 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk"/>
Nov 16 05:49:02 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:49:02 user nova-compute[80928]:     </disk>
Nov 16 05:49:02 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:49:02 user nova-compute[80928]:       <mac address="fa:16:3e:86:53:a9"/>
Nov 16 05:49:02 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:49:02 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:49:02 user nova-compute[80928]:       <target dev="tap7453ccbb-c8"/>
Nov 16 05:49:02 user nova-compute[80928]:     </interface>
Nov 16 05:49:02 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:49:02 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/console.log" append="off"/>
Nov 16 05:49:02 user nova-compute[80928]:     </serial>
Nov 16 05:49:02 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:49:02 user nova-compute[80928]:     <video>
Nov 16 05:49:02 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:49:02 user nova-compute[80928]:     </video>
Nov 16 05:49:02 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:49:02 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:49:02 user nova-compute[80928]:     </rng>
Nov 16 05:49:02 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:49:02 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:49:02 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:49:02 user nova-compute[80928]:     </memballoon>
Nov 16 05:49:02 user nova-compute[80928]:   </devices>
Nov 16 05:49:02 user nova-compute[80928]: </domain>
Nov 16 05:49:02 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1608335381',display_name='tempest-AttachVolumeTestJSON-server-1608335381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1608335381',id=38,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIheiaIxPwP6SA4L1FNfT/iVP2oIcKbZWevRs6N7x4qvsfqzxVVfO6fF8zGk5rw0ndDEv99BxFLQjD1+Tt+oqfeijNH8TrsvSWOfBX1YC4BXEZkch1QPW+6pCo5Kkt1+w==',key_name='tempest-keypair-845255928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05d6e74da88a497ca920dcb2e07ea05a',ramdisk_id='',reservation_id='r-yk964sbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1530907565',owner_user_name='tempest-AttachVolumeTestJSON-1530907565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be30aca2412b475498f99dddb86c5983',uuid=35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converting VIF {"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG os_vif [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50d70bc0-7b04-5cff-8efb-69c0a29cf2a8', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7453ccbb-c8, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7453ccbb-c8, col_values=(('qos', UUID('c574da88-07d6-4b1c-a4e1-1c5422713caf')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7453ccbb-c8, col_values=(('external_ids', {'iface-id': '7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:53:a9', 'vm-uuid': '35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:02 user nova-compute[80928]: INFO os_vif [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8')
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:49:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No VIF found with MAC fa:16:3e:86:53:a9, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:49:03 user nova-compute[80928]: DEBUG nova.network.neutron [req-71008bac-3adb-42bf-a9fd-754c8731b07f req-d8cafe3d-ab6e-4af8-946e-3f2657960440 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updated VIF entry in instance network info cache for port 7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:49:03 user nova-compute[80928]: DEBUG nova.network.neutron [req-71008bac-3adb-42bf-a9fd-754c8731b07f req-d8cafe3d-ab6e-4af8-946e-3f2657960440 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updating instance_info_cache with network_info: [{"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:49:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-71008bac-3adb-42bf-a9fd-754c8731b07f req-d8cafe3d-ab6e-4af8-946e-3f2657960440 service nova] Releasing lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:49:03 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:49:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-dd1f0bb0-e2a3-4b3d-ac06-2827c5bf9120 req-5540ba46-2af2-40de-bcc5-18dfaf8d62a0 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:49:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dd1f0bb0-e2a3-4b3d-ac06-2827c5bf9120 req-5540ba46-2af2-40de-bcc5-18dfaf8d62a0 service nova] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dd1f0bb0-e2a3-4b3d-ac06-2827c5bf9120 req-5540ba46-2af2-40de-bcc5-18dfaf8d62a0 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dd1f0bb0-e2a3-4b3d-ac06-2827c5bf9120 req-5540ba46-2af2-40de-bcc5-18dfaf8d62a0 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-dd1f0bb0-e2a3-4b3d-ac06-2827c5bf9120 req-5540ba46-2af2-40de-bcc5-18dfaf8d62a0 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] No waiting events found dispatching network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:49:04 user nova-compute[80928]: WARNING nova.compute.manager [req-dd1f0bb0-e2a3-4b3d-ac06-2827c5bf9120 req-5540ba46-2af2-40de-bcc5-18dfaf8d62a0 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received unexpected event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 for instance with vm_state building and task_state spawning.
Nov 16 05:49:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:04 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:49:06 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance spawned successfully.
Nov 16 05:49:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:49:06 user nova-compute[80928]: INFO nova.compute.manager [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 16 05:49:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:49:06 user nova-compute[80928]: INFO nova.compute.manager [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Took 5.78 seconds to build instance.
Nov 16 05:49:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-47fb4782-4a88-4fbf-bb51-24a2ab049dc9 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.874s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-e610e583-608c-40ea-8307-fc3db66e25b1 req-847e92f3-c021-4e1e-a8a8-991d085fa6b8 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e610e583-608c-40ea-8307-fc3db66e25b1 req-847e92f3-c021-4e1e-a8a8-991d085fa6b8 service nova] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e610e583-608c-40ea-8307-fc3db66e25b1 req-847e92f3-c021-4e1e-a8a8-991d085fa6b8 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e610e583-608c-40ea-8307-fc3db66e25b1 req-847e92f3-c021-4e1e-a8a8-991d085fa6b8 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-e610e583-608c-40ea-8307-fc3db66e25b1 req-847e92f3-c021-4e1e-a8a8-991d085fa6b8 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] No waiting events found dispatching network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:49:06 user nova-compute[80928]: WARNING nova.compute.manager [req-e610e583-608c-40ea-8307-fc3db66e25b1 req-847e92f3-c021-4e1e-a8a8-991d085fa6b8 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received unexpected event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 for instance with vm_state active and task_state None.
Nov 16 05:49:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:08 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:49:08 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'flavor' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:09 user nova-compute[80928]: INFO nova.compute.manager [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attaching volume 4ee67813-8388-4cb9-95c7-3c187d55fc18 to /dev/vdb
Nov 16 05:49:09 user nova-compute[80928]: DEBUG os_brick.utils [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6b80dc-971b-40c3-886e-a8686c850f7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[84da6c57-9269-4ae3-a573-7b8603b3f022]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c5afc2-cccc-4bb4-a8d2-43b2cd10ef46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4801a297-8ff9-4ab1-b859-63beb8b8a49f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:49:09 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cdf3d8-61b4-4eae-a401-ca7e4c243f50]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG os_brick.utils [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Updating existing volume attachment record: 5f2a387c-0c9a-47a3-acd3-98dd7838d56a {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:49:09 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:49:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:49:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:12 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:49:12 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:49:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:49:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:49:12 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:49:13 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Updating instance_info_cache with network_info: [{"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:49:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-4a171080-2c54-4092-902d-7a3f815656b9" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:49:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:49:13 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGpCXlEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:49:14 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:49:14 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:49:14 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5575388b-4a1d-41c3-9521-67f4c94da597]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:49:14 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0562f71-5a73-4bcf-8207-b2ecd9ca680f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18] added
Nov 16 05:49:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdea5db0-7b36-437c-a890-ea535236928b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f49403-c947-4c1e-9b97-0bcfcb9f45b3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KGpCXlEa {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KGpCXlEa" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[623397c7-7eb0-4177-bfa8-e18f4b6cd45b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KGpCXlEa'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5764ee6-fee2-44bf-9c57-c9277b078c4d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[905cabb4-9613-4262-b9a3-2ea143793d97]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:49:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:49:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[64317caf-4d8b-48a4-b802-cb30df2a6104]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18, portal: 172.16.0.220,3260]
Nov 16 05:49:14 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18, portal: 172.16.0.220,3260] successful.
Nov 16 05:49:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a3da52-945f-41ff-b633-aa55eb31c348]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef4e223-d21a-4d42-b399-5cbbdfa0e365]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:49:14 user nova-compute[80928]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 (non-flash)
Nov 16 05:49:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:49:14 user nova-compute[80928]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 (non-flash)
Nov 16 05:49:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad53d8d-18a0-4efe-8e7a-520ba907b5f3]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGpCXlEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23238663535313834', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238663535313834', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'flavor' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:49:16 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:49:16 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 05:49:16 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:49:16 user nova-compute[80928]:   <serial>4ee67813-8388-4cb9-95c7-3c187d55fc18</serial>
Nov 16 05:49:16 user nova-compute[80928]: </disk>
Nov 16 05:49:16 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] No VIF found with MAC fa:16:3e:fa:d8:93, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f87c2ccd-88fc-4101-a9f6-c8fc05339f25 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.277s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:49:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:18 user nova-compute[80928]: INFO nova.compute.manager [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Detaching volume 4ee67813-8388-4cb9-95c7-3c187d55fc18
Nov 16 05:49:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:18 user nova-compute[80928]: INFO nova.virt.block_device [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Attempting to driver detach volume 4ee67813-8388-4cb9-95c7-3c187d55fc18 from mountpoint /dev/vdb
Nov 16 05:49:19 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:49:19 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=7922MB free_disk=25.16156005859375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Attempting to detach device vdb from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:49:19 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:49:19 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 05:49:19 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:49:19 user nova-compute[80928]:   <serial>4ee67813-8388-4cb9-95c7-3c187d55fc18</serial>
Nov 16 05:49:19 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:49:19 user nova-compute[80928]: </disk>
Nov 16 05:49:19 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:49:19 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Successfully detached device vdb from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the persistent domain config.
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:49:19 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:49:19 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 05:49:19 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:49:19 user nova-compute[80928]:   <serial>4ee67813-8388-4cb9-95c7-3c187d55fc18</serial>
Nov 16 05:49:19 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:49:19 user nova-compute[80928]: </disk>
Nov 16 05:49:19 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance e6ff1633-6efc-4953-94c0-37dfca5eb077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 98701a69-085d-44f5-8eb0-effd8917f6b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:49:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:24 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:49:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Acquiring lock "e6ff1633-6efc-4953-94c0-37dfca5eb077" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Acquiring lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:25 user nova-compute[80928]: INFO nova.compute.manager [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Terminating instance
Nov 16 05:49:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d96fea1c-6028-4a98-9a19-8df89cc535f5 req-877e1cca-0d04-41cc-91b2-e6e3ee000d4b service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Received event network-vif-unplugged-524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d96fea1c-6028-4a98-9a19-8df89cc535f5 req-877e1cca-0d04-41cc-91b2-e6e3ee000d4b service nova] Acquiring lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d96fea1c-6028-4a98-9a19-8df89cc535f5 req-877e1cca-0d04-41cc-91b2-e6e3ee000d4b service nova] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d96fea1c-6028-4a98-9a19-8df89cc535f5 req-877e1cca-0d04-41cc-91b2-e6e3ee000d4b service nova] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d96fea1c-6028-4a98-9a19-8df89cc535f5 req-877e1cca-0d04-41cc-91b2-e6e3ee000d4b service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] No waiting events found dispatching network-vif-unplugged-524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:49:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d96fea1c-6028-4a98-9a19-8df89cc535f5 req-877e1cca-0d04-41cc-91b2-e6e3ee000d4b service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Received event network-vif-unplugged-524ec955-2738-4212-90ba-e23f9804ac4f for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Instance destroyed successfully.
Nov 16 05:49:26 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lazy-loading 'resources' on Instance uuid e6ff1633-6efc-4953-94c0-37dfca5eb077 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:47:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1392975638',display_name='tempest-VolumesNegativeTest-instance-1392975638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1392975638',id=36,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:47:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d01062a1fa849f1adce598ee2e8d82f',ramdisk_id='',reservation_id='r-kdtc1miz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-594880716',owner_user_name='tempest-VolumesNegativeTest-594880716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:47:42Z,user_data=None,user_id='f2a2fb6c2d474177b92c5b3818fe492f',uuid=e6ff1633-6efc-4953-94c0-37dfca5eb077,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "524ec955-2738-4212-90ba-e23f9804ac4f", "address": "fa:16:3e:35:1d:37", "network": {"id": "1f73cebe-2904-47e2-ba79-836411d9f25e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "28be64da55224dbd92019438281cfb48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524ec955-27", "ovs_interfaceid": "524ec955-2738-4212-90ba-e23f9804ac4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Converting VIF {"id": "524ec955-2738-4212-90ba-e23f9804ac4f", "address": "fa:16:3e:35:1d:37", "network": {"id": "1f73cebe-2904-47e2-ba79-836411d9f25e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "28be64da55224dbd92019438281cfb48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524ec955-27", "ovs_interfaceid": "524ec955-2738-4212-90ba-e23f9804ac4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1d:37,bridge_name='br-int',has_traffic_filtering=True,id=524ec955-2738-4212-90ba-e23f9804ac4f,network=Network(1f73cebe-2904-47e2-ba79-836411d9f25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524ec955-27') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG os_vif [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1d:37,bridge_name='br-int',has_traffic_filtering=True,id=524ec955-2738-4212-90ba-e23f9804ac4f,network=Network(1f73cebe-2904-47e2-ba79-836411d9f25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524ec955-27') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap524ec955-27, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05c94933-baa2-40de-bfbe-18fa902829c3) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:49:26 user nova-compute[80928]: INFO os_vif [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1d:37,bridge_name='br-int',has_traffic_filtering=True,id=524ec955-2738-4212-90ba-e23f9804ac4f,network=Network(1f73cebe-2904-47e2-ba79-836411d9f25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524ec955-27')
Nov 16 05:49:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Deleting instance files /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077_del
Nov 16 05:49:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Deletion of /opt/stack/data/nova/instances/e6ff1633-6efc-4953-94c0-37dfca5eb077_del complete
Nov 16 05:49:26 user nova-compute[80928]: INFO nova.compute.manager [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 16 05:49:26 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:49:26 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Took 0.48 seconds to deallocate network for instance.
Nov 16 05:49:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-3522de8b-80d7-4d06-9935-2b282936d516 req-3547020e-c97e-4e6b-b5de-0407111c51bd service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Received event network-vif-deleted-524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:27 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:49:27 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:49:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:27 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Deleted allocations for instance e6ff1633-6efc-4953-94c0-37dfca5eb077
Nov 16 05:49:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e17a0fd6-3365-4f4e-965d-da5ebbc84c59 tempest-VolumesNegativeTest-594880716 tempest-VolumesNegativeTest-594880716-project-member] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.616s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-03143845-6013-4aff-9909-aed37d552b6d req-bd51bce1-0435-4a83-a778-3b492fa3e4c3 service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Received event network-vif-plugged-524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:49:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-03143845-6013-4aff-9909-aed37d552b6d req-bd51bce1-0435-4a83-a778-3b492fa3e4c3 service nova] Acquiring lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-03143845-6013-4aff-9909-aed37d552b6d req-bd51bce1-0435-4a83-a778-3b492fa3e4c3 service nova] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-03143845-6013-4aff-9909-aed37d552b6d req-bd51bce1-0435-4a83-a778-3b492fa3e4c3 service nova] Lock "e6ff1633-6efc-4953-94c0-37dfca5eb077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-03143845-6013-4aff-9909-aed37d552b6d req-bd51bce1-0435-4a83-a778-3b492fa3e4c3 service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] No waiting events found dispatching network-vif-plugged-524ec955-2738-4212-90ba-e23f9804ac4f {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:49:27 user nova-compute[80928]: WARNING nova.compute.manager [req-03143845-6013-4aff-9909-aed37d552b6d req-bd51bce1-0435-4a83-a778-3b492fa3e4c3 service nova] [instance: e6ff1633-6efc-4953-94c0-37dfca5eb077] Received unexpected event network-vif-plugged-524ec955-2738-4212-90ba-e23f9804ac4f for instance with vm_state deleted and task_state None.
Nov 16 05:49:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:39 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af is timed out.
Nov 16 05:49:39 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Successfully detached device vdb from instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af from the live domain config.
Nov 16 05:49:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGpCXlEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:49:39 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f83668-553c-4bad-b64a-f1e292e9f6dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:49:39 user nova-compute[80928]: No targets found.
Nov 16 05:49:39 user nova-compute[80928]: iSNS:
Nov 16 05:49:39 user nova-compute[80928]: No targets found.
Nov 16 05:49:39 user nova-compute[80928]: STATIC:
Nov 16 05:49:39 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a
Nov 16 05:49:39 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:49:39 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:49:39 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18
Nov 16 05:49:39 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:49:39 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:49:39 user nova-compute[80928]: FIRMWARE:
Nov 16 05:49:39 user nova-compute[80928]: No targets found.
Nov 16 05:49:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:49:39 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:49:39 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c8299a-c3c2-4c95-a7d1-26817f135f96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a74c7b-1542-4b7a-ab6b-9c90ba175893]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:49:39 user nova-compute[80928]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 (non-flash)
Nov 16 05:49:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:49:39 user nova-compute[80928]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 (non-flash)
Nov 16 05:49:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f865822d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb938f6-d0c9-43f6-a899-13c3299221b5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[327e82d3-866b-482b-9fb9-08b8111e404e]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[371e1d90-55be-4013-be31-b8108033cdf6]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0702201e-5595-456e-a9c9-244cfccf1fb6]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e37fa19-f032-45c4-a20f-431ec5641a34]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f83cae-331f-489a-b42d-8522462c38a5]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18, portal: 172.16.0.220,3260]
Nov 16 05:49:39 user nova-compute[80928]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18, portal: 172.16.0.220,3260] successful.
Nov 16 05:49:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee67813-8388-4cb9-95c7-3c187d55fc18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2161ffa8-21ac-40bb-a767-6cbb4f87476a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] <== disconnect_volume: return (295ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:49:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:49:40 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'flavor' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:49:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2649bd77-bbba-4ed8-b48d-bc0ea435d750 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.010s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:49:41 user nova-compute[80928]: INFO nova.compute.manager [None req-328d736d-4da4-4d5b-86f1-1aa6c6397136 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Unrescuing
Nov 16 05:49:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-328d736d-4da4-4d5b-86f1-1aa6c6397136 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:49:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-328d736d-4da4-4d5b-86f1-1aa6c6397136 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquired lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:49:41 user nova-compute[80928]: DEBUG nova.network.neutron [None req-328d736d-4da4-4d5b-86f1-1aa6c6397136 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG nova.network.neutron [None req-328d736d-4da4-4d5b-86f1-1aa6c6397136 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updating instance_info_cache with network_info: [{"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-328d736d-4da4-4d5b-86f1-1aa6c6397136 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Releasing lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG nova.objects.instance [None req-328d736d-4da4-4d5b-86f1-1aa6c6397136 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'flavor' on Instance uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-a8b518ca-f97e-4ce0-b2ad-ffa791469921 req-aad860c3-0877-496b-af4a-ca0d411dbd83 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-unplugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a8b518ca-f97e-4ce0-b2ad-ffa791469921 req-aad860c3-0877-496b-af4a-ca0d411dbd83 service nova] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a8b518ca-f97e-4ce0-b2ad-ffa791469921 req-aad860c3-0877-496b-af4a-ca0d411dbd83 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a8b518ca-f97e-4ce0-b2ad-ffa791469921 req-aad860c3-0877-496b-af4a-ca0d411dbd83 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-a8b518ca-f97e-4ce0-b2ad-ffa791469921 req-aad860c3-0877-496b-af4a-ca0d411dbd83 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] No waiting events found dispatching network-vif-unplugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:49:42 user nova-compute[80928]: WARNING nova.compute.manager [req-a8b518ca-f97e-4ce0-b2ad-ffa791469921 req-aad860c3-0877-496b-af4a-ca0d411dbd83 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received unexpected event network-vif-unplugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:49:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:42 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Instance destroyed successfully.
Nov 16 05:49:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-99467c7d-3733-488c-912a-4b653f1d5277 req-fdc9ae2b-8772-41f7-af55-8ff02e6f458b service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:49:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-99467c7d-3733-488c-912a-4b653f1d5277 req-fdc9ae2b-8772-41f7-af55-8ff02e6f458b service nova] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-99467c7d-3733-488c-912a-4b653f1d5277 req-fdc9ae2b-8772-41f7-af55-8ff02e6f458b service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-99467c7d-3733-488c-912a-4b653f1d5277 req-fdc9ae2b-8772-41f7-af55-8ff02e6f458b service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-99467c7d-3733-488c-912a-4b653f1d5277 req-fdc9ae2b-8772-41f7-af55-8ff02e6f458b service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] No waiting events found dispatching network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:49:44 user nova-compute[80928]: WARNING nova.compute.manager [req-99467c7d-3733-488c-912a-4b653f1d5277 req-fdc9ae2b-8772-41f7-af55-8ff02e6f458b service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received unexpected event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:49:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-99467c7d-3733-488c-912a-4b653f1d5277 req-fdc9ae2b-8772-41f7-af55-8ff02e6f458b service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:49:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-99467c7d-3733-488c-912a-4b653f1d5277 req-fdc9ae2b-8772-41f7-af55-8ff02e6f458b service nova] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-99467c7d-3733-488c-912a-4b653f1d5277 req-fdc9ae2b-8772-41f7-af55-8ff02e6f458b service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-99467c7d-3733-488c-912a-4b653f1d5277 req-fdc9ae2b-8772-41f7-af55-8ff02e6f458b service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-99467c7d-3733-488c-912a-4b653f1d5277 req-fdc9ae2b-8772-41f7-af55-8ff02e6f458b service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] No waiting events found dispatching network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:49:44 user nova-compute[80928]: WARNING nova.compute.manager [req-99467c7d-3733-488c-912a-4b653f1d5277 req-fdc9ae2b-8772-41f7-af55-8ff02e6f458b service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received unexpected event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:49:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-82e19fb3-042d-44c6-bc14-7df040fdcfa7 req-1ba02419-393e-4d7d-8ada-2f088878b400 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:49:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-82e19fb3-042d-44c6-bc14-7df040fdcfa7 req-1ba02419-393e-4d7d-8ada-2f088878b400 service nova] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:49:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-82e19fb3-042d-44c6-bc14-7df040fdcfa7 req-1ba02419-393e-4d7d-8ada-2f088878b400 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:49:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-82e19fb3-042d-44c6-bc14-7df040fdcfa7 req-1ba02419-393e-4d7d-8ada-2f088878b400 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:49:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-82e19fb3-042d-44c6-bc14-7df040fdcfa7 req-1ba02419-393e-4d7d-8ada-2f088878b400 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] No waiting events found dispatching network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:49:46 user nova-compute[80928]: WARNING nova.compute.manager [req-82e19fb3-042d-44c6-bc14-7df040fdcfa7 req-1ba02419-393e-4d7d-8ada-2f088878b400 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received unexpected event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 for instance with vm_state rescued and task_state unrescuing.
Nov 16 05:49:46 user nova-compute[80928]: DEBUG nova.compute.manager [None req-328d736d-4da4-4d5b-86f1-1aa6c6397136 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:49:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:49:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:49:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:49:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:49:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:49:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:03 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:50:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances with incomplete migration  {{(pid=80928) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 05:50:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-09ca9448-6ef3-4275-9639-0e73c21c2828 req-8078e8c9-6de0-4a2b-88b5-5ed81eafe688 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Received event network-changed-4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG nova.compute.manager [req-09ca9448-6ef3-4275-9639-0e73c21c2828 req-8078e8c9-6de0-4a2b-88b5-5ed81eafe688 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Refreshing instance network info cache due to event network-changed-4e39500a-73df-4081-923c-e7e8913ee64c. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-09ca9448-6ef3-4275-9639-0e73c21c2828 req-8078e8c9-6de0-4a2b-88b5-5ed81eafe688 service nova] Acquiring lock "refresh_cache-98701a69-085d-44f5-8eb0-effd8917f6b5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-09ca9448-6ef3-4275-9639-0e73c21c2828 req-8078e8c9-6de0-4a2b-88b5-5ed81eafe688 service nova] Acquired lock "refresh_cache-98701a69-085d-44f5-8eb0-effd8917f6b5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-09ca9448-6ef3-4275-9639-0e73c21c2828 req-8078e8c9-6de0-4a2b-88b5-5ed81eafe688 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Refreshing network info cache for port 4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-09ca9448-6ef3-4275-9639-0e73c21c2828 req-8078e8c9-6de0-4a2b-88b5-5ed81eafe688 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Updated VIF entry in instance network info cache for port 4e39500a-73df-4081-923c-e7e8913ee64c. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG nova.network.neutron [req-09ca9448-6ef3-4275-9639-0e73c21c2828 req-8078e8c9-6de0-4a2b-88b5-5ed81eafe688 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Updating instance_info_cache with network_info: [{"id": "4e39500a-73df-4081-923c-e7e8913ee64c", "address": "fa:16:3e:50:29:ec", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39500a-73", "ovs_interfaceid": "4e39500a-73df-4081-923c-e7e8913ee64c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "98701a69-085d-44f5-8eb0-effd8917f6b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lazy-loading 'flavor' on Instance uuid 98701a69-085d-44f5-8eb0-effd8917f6b5 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-09ca9448-6ef3-4275-9639-0e73c21c2828 req-8078e8c9-6de0-4a2b-88b5-5ed81eafe688 service nova] Releasing lock "refresh_cache-98701a69-085d-44f5-8eb0-effd8917f6b5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "98701a69-085d-44f5-8eb0-effd8917f6b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:06 user nova-compute[80928]: INFO nova.compute.manager [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Attaching volume 5773fba9-e371-4321-942d-f752c2d6e471 to /dev/vdb
Nov 16 05:50:07 user nova-compute[80928]: DEBUG os_brick.utils [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[836da75c-3c91-4062-885a-d227e69cfeb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11c5e23-b0d2-43fd-90a1-014a2c927c69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3bbc71-45fb-4fa8-87ff-f084a44918d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff55b92f-afe3-4813-b6b7-bca3bef5c5ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:50:07 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:50:07 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c90ba9b-8e8e-4bb8-a706-791f0f1457d9]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG os_brick.utils [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:50:07 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Updating existing volume attachment record: b07d68d8-e77b-4f69-9341-18890f862519 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:50:08 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:50:09 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:50:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:50:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:11 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNKCwEID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:50:12 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:50:12 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:50:12 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e04ee23-fb73-49ea-ba83-cff5e68d5a35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:50:12 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd0d1d4-b973-400f-bd48-da53cd1c46d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471] added
Nov 16 05:50:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e920933-050d-4380-a091-3c36a69eca8f]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7295aaa4-7d69-4c17-824c-8b9c1d924d8f]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNKCwEID {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNKCwEID" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9701c44a-4c83-4942-a43e-e2052308c69e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yNKCwEID'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbd3740-cced-4b72-b79c-f6c9f762e48c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[865f4df4-71f8-41ec-a693-f4850cdeea59]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:50:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:50:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dbb100-75d8-4354-a490-cbf7f0da513f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471, portal: 172.16.0.220,3260]
Nov 16 05:50:12 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471, portal: 172.16.0.220,3260] successful.
Nov 16 05:50:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b8756f-d83b-4752-a68a-11d34a1f704d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fc06c3-dd08-4dac-9ba2-76d6189ff8c0]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:50:12 user nova-compute[80928]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 (non-flash)
Nov 16 05:50:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:50:12 user nova-compute[80928]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 (non-flash)
Nov 16 05:50:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3c84a6-2053-43cb-a8b8-8495b9923300]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:50:12 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:50:13 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Updating instance_info_cache with network_info: [{"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:50:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:50:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:50:13 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:50:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNKCwEID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:50:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:50:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26139643636653064', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:50:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139643636653064', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:50:13 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lazy-loading 'flavor' on Instance uuid 98701a69-085d-44f5-8eb0-effd8917f6b5 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:50:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:50:13 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:50:13 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 05:50:13 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:50:13 user nova-compute[80928]:   <serial>5773fba9-e371-4321-942d-f752c2d6e471</serial>
Nov 16 05:50:13 user nova-compute[80928]: </disk>
Nov 16 05:50:13 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:50:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:50:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:50:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] No VIF found with MAC fa:16:3e:50:29:ec, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:50:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c272df8f-97d4-4065-9c40-ebb74907c214 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.392s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:50:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:50:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:14 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:50:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "98701a69-085d-44f5-8eb0-effd8917f6b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:15 user nova-compute[80928]: INFO nova.compute.manager [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Detaching volume 5773fba9-e371-4321-942d-f752c2d6e471
Nov 16 05:50:15 user nova-compute[80928]: INFO nova.virt.block_device [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Attempting to driver detach volume 5773fba9-e371-4321-942d-f752c2d6e471 from mountpoint /dev/vdb
Nov 16 05:50:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Attempting to detach device vdb from instance 98701a69-085d-44f5-8eb0-effd8917f6b5 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:50:15 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:50:15 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 05:50:15 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:50:15 user nova-compute[80928]:   <serial>5773fba9-e371-4321-942d-f752c2d6e471</serial>
Nov 16 05:50:15 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:50:15 user nova-compute[80928]: </disk>
Nov 16 05:50:15 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:15 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Successfully detached device vdb from instance 98701a69-085d-44f5-8eb0-effd8917f6b5 from the persistent domain config.
Nov 16 05:50:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98701a69-085d-44f5-8eb0-effd8917f6b5 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:50:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:50:15 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:50:15 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 05:50:15 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:50:15 user nova-compute[80928]:   <serial>5773fba9-e371-4321-942d-f752c2d6e471</serial>
Nov 16 05:50:15 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:50:15 user nova-compute[80928]: </disk>
Nov 16 05:50:15 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98701a69-085d-44f5-8eb0-effd8917f6b5 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:50:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:18 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:50:18 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8122MB free_disk=25.150123596191406GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 98701a69-085d-44f5-8eb0-effd8917f6b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing inventories for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating ProviderTree inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing aggregate associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, aggregates: None {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 05:50:18 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing trait associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 05:50:19 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:50:19 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:50:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:50:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:26 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:50:26 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:50:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:50:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:50:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:50:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:50:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:26 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:50:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:28 user nova-compute[80928]: INFO nova.compute.manager [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Terminating instance
Nov 16 05:50:28 user nova-compute[80928]: DEBUG nova.compute.manager [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-167dbb4b-a468-4d93-abcd-d18c05551578 req-d36efd1b-d86a-46f2-b706-eac15d3b044a service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Received event network-vif-unplugged-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-167dbb4b-a468-4d93-abcd-d18c05551578 req-d36efd1b-d86a-46f2-b706-eac15d3b044a service nova] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-167dbb4b-a468-4d93-abcd-d18c05551578 req-d36efd1b-d86a-46f2-b706-eac15d3b044a service nova] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-167dbb4b-a468-4d93-abcd-d18c05551578 req-d36efd1b-d86a-46f2-b706-eac15d3b044a service nova] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-167dbb4b-a468-4d93-abcd-d18c05551578 req-d36efd1b-d86a-46f2-b706-eac15d3b044a service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] No waiting events found dispatching network-vif-unplugged-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-167dbb4b-a468-4d93-abcd-d18c05551578 req-d36efd1b-d86a-46f2-b706-eac15d3b044a service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Received event network-vif-unplugged-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:50:29 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Instance destroyed successfully.
Nov 16 05:50:29 user nova-compute[80928]: DEBUG nova.objects.instance [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lazy-loading 'resources' on Instance uuid 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1587916826',display_name='tempest-SnapshotDataIntegrityTests-server-1587916826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1587916826',id=32,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+Sfp8Nb061ty6rWe7039S/9YIQDNJl9bazLsrqbPtdtENrQpeywOn9Y1jQult7XVrFNs7fzn+94TXLm16ulBrnJgtJ6lGtylNGnZ6uM2L1rxTtHoEh5jplEAtQupJsfg==',key_name='tempest-keypair-482834326',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:44:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64c114702dc14f2d8462f313ea4999af',ramdisk_id='',reservation_id='r-yhvwli7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1321900073',owner_user_name='tempest-SnapshotDataIntegrityTests-1321900073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:44:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aa0aac565144c2d93bc4c649f60c462',uuid=22d30cdf-c6b3-4cf1-8caa-80223f9fe3af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "address": "fa:16:3e:fa:d8:93", "network": {"id": "7de5f7dc-2d57-44b1-abd9-e135d7a3428b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-448110210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64c114702dc14f2d8462f313ea4999af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f77cc7a-2a", "ovs_interfaceid": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Converting VIF {"id": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "address": "fa:16:3e:fa:d8:93", "network": {"id": "7de5f7dc-2d57-44b1-abd9-e135d7a3428b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-448110210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64c114702dc14f2d8462f313ea4999af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f77cc7a-2a", "ovs_interfaceid": "4f77cc7a-2a19-4f3c-bbd4-d74d36912c91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:d8:93,bridge_name='br-int',has_traffic_filtering=True,id=4f77cc7a-2a19-4f3c-bbd4-d74d36912c91,network=Network(7de5f7dc-2d57-44b1-abd9-e135d7a3428b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f77cc7a-2a') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG os_vif [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:d8:93,bridge_name='br-int',has_traffic_filtering=True,id=4f77cc7a-2a19-4f3c-bbd4-d74d36912c91,network=Network(7de5f7dc-2d57-44b1-abd9-e135d7a3428b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f77cc7a-2a') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f77cc7a-2a, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ff0e03e-b3e3-4fe5-9d75-01589f4798cd) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] There are 0 instances to clean {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 05:50:29 user nova-compute[80928]: INFO os_vif [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:d8:93,bridge_name='br-int',has_traffic_filtering=True,id=4f77cc7a-2a19-4f3c-bbd4-d74d36912c91,network=Network(7de5f7dc-2d57-44b1-abd9-e135d7a3428b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f77cc7a-2a')
Nov 16 05:50:29 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Deleting instance files /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af_del
Nov 16 05:50:29 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Deletion of /opt/stack/data/nova/instances/22d30cdf-c6b3-4cf1-8caa-80223f9fe3af_del complete
Nov 16 05:50:29 user nova-compute[80928]: INFO nova.compute.manager [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 16 05:50:29 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:50:29 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:50:30 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:50:30 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Took 0.63 seconds to deallocate network for instance.
Nov 16 05:50:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-f95bbecf-ba38-473e-aa66-5f083528f7ec req-e35f4849-4524-496b-b394-1750ba68e1fc service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Received event network-vif-deleted-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:50:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:30 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:50:30 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:50:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:31 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Deleted allocations for instance 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af
Nov 16 05:50:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-6f5a621e-9ebc-4d0f-b7f2-6023365b7ae2 tempest-SnapshotDataIntegrityTests-1321900073 tempest-SnapshotDataIntegrityTests-1321900073-project-member] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.130s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-348a292c-e9f8-4fb3-b395-8f8008258796 req-67982fbd-db18-46ec-a300-0e4736e595ab service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Received event network-vif-plugged-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:50:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-348a292c-e9f8-4fb3-b395-8f8008258796 req-67982fbd-db18-46ec-a300-0e4736e595ab service nova] Acquiring lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-348a292c-e9f8-4fb3-b395-8f8008258796 req-67982fbd-db18-46ec-a300-0e4736e595ab service nova] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-348a292c-e9f8-4fb3-b395-8f8008258796 req-67982fbd-db18-46ec-a300-0e4736e595ab service nova] Lock "22d30cdf-c6b3-4cf1-8caa-80223f9fe3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-348a292c-e9f8-4fb3-b395-8f8008258796 req-67982fbd-db18-46ec-a300-0e4736e595ab service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] No waiting events found dispatching network-vif-plugged-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:50:31 user nova-compute[80928]: WARNING nova.compute.manager [req-348a292c-e9f8-4fb3-b395-8f8008258796 req-67982fbd-db18-46ec-a300-0e4736e595ab service nova] [instance: 22d30cdf-c6b3-4cf1-8caa-80223f9fe3af] Received unexpected event network-vif-plugged-4f77cc7a-2a19-4f3c-bbd4-d74d36912c91 for instance with vm_state deleted and task_state None.
Nov 16 05:50:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:36 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 98701a69-085d-44f5-8eb0-effd8917f6b5 is timed out.
Nov 16 05:50:36 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Successfully detached device vdb from instance 98701a69-085d-44f5-8eb0-effd8917f6b5 from the live domain config.
Nov 16 05:50:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNKCwEID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:50:36 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f20438-4627-40c7-8d8b-abfdcd761c83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:50:36 user nova-compute[80928]: No targets found.
Nov 16 05:50:36 user nova-compute[80928]: iSNS:
Nov 16 05:50:36 user nova-compute[80928]: No targets found.
Nov 16 05:50:36 user nova-compute[80928]: STATIC:
Nov 16 05:50:36 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a
Nov 16 05:50:36 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:50:36 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:50:36 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471
Nov 16 05:50:36 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:50:36 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:50:36 user nova-compute[80928]: FIRMWARE:
Nov 16 05:50:36 user nova-compute[80928]: No targets found.
Nov 16 05:50:36 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:50:36 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:50:36 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[894b78f8-9f66-4f85-a04c-023a1c5f6986]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b105dff9-2992-443b-8536-0992311a737b]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:50:36 user nova-compute[80928]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 (non-flash)
Nov 16 05:50:36 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:50:36 user nova-compute[80928]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 (non-flash)
Nov 16 05:50:36 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[77477ad8-42f5-467f-bbd1-a4ccfe8a14d7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0306e6ec-3530-4ca8-9e98-71f74efbf0a9]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c400c6-738c-4ec6-8328-4fbde3b94953]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[235f75de-cb21-447d-ac35-e3b035da8085]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dde9e3-a324-4202-9562-d362522c4b44]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a7c172-ae74-4e89-93ec-518312beb8c3]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471, portal: 172.16.0.220,3260]
Nov 16 05:50:36 user nova-compute[80928]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471, portal: 172.16.0.220,3260] successful.
Nov 16 05:50:36 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5773fba9-e371-4321-942d-f752c2d6e471 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f073ea04-d621-47fc-b104-4899a2fcb98a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] <== disconnect_volume: return (305ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:50:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:50:37 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lazy-loading 'flavor' on Instance uuid 98701a69-085d-44f5-8eb0-effd8917f6b5 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:50:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f691f12a-277a-427d-8820-fcb3fb07d568 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.735s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:50:42 user nova-compute[80928]: INFO nova.compute.claims [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Claim successful on node user
Nov 16 05:50:42 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG nova.network.neutron [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:50:42 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:50:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG nova.policy [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f68adc47ff640f6ae433684f457db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab83b1fb4d343d08be479f5c56eb843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:50:42 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Creating image(s)
Nov 16 05:50:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "/opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "/opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "/opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "276e1b96044f056d9abdaf0761a34a51ae5aa73a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "276e1b96044f056d9abdaf0761a34a51ae5aa73a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a.part --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:43 user nova-compute[80928]: DEBUG nova.network.neutron [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Successfully created port: 7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:50:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a.part --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:43 user nova-compute[80928]: DEBUG nova.virt.images [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] f1bbac86-d836-4690-9bee-04adeac6d7b2 was qcow2, converting to raw {{(pid=80928) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 05:50:43 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:50:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a.part /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a.converted {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a.part /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a.converted" returned: 0 in 0.498s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a.converted --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "276e1b96044f056d9abdaf0761a34a51ae5aa73a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.438s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.network.neutron [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Successfully updated port: 7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquired lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.network.neutron [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-4b519f13-0c5c-42e9-9041-4ceed1c246fd req-ebd48b45-6818-4b35-ace4-51183049bbfa service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-changed-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-4b519f13-0c5c-42e9-9041-4ceed1c246fd req-ebd48b45-6818-4b35-ace4-51183049bbfa service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Refreshing instance network info cache due to event network-changed-7182f759-123a-4764-9949-767ac0f4ddb6. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4b519f13-0c5c-42e9-9041-4ceed1c246fd req-ebd48b45-6818-4b35-ace4-51183049bbfa service nova] Acquiring lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "276e1b96044f056d9abdaf0761a34a51ae5aa73a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "276e1b96044f056d9abdaf0761a34a51ae5aa73a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.network.neutron [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a --force-share --output=json" returned: 0 in 0.168s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a,backing_fmt=raw /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a,backing_fmt=raw /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk 1073741824" returned: 0 in 0.048s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "276e1b96044f056d9abdaf0761a34a51ae5aa73a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.network.neutron [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updating instance_info_cache with network_info: [{"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Releasing lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Instance network_info: |[{"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4b519f13-0c5c-42e9-9041-4ceed1c246fd req-ebd48b45-6818-4b35-ace4-51183049bbfa service nova] Acquired lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.network.neutron [req-4b519f13-0c5c-42e9-9041-4ceed1c246fd req-ebd48b45-6818-4b35-ace4-51183049bbfa service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Refreshing network info cache for port 7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Cannot resize image /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Ensure instance console log exists: /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Start _get_guest_xml network_info=[{"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:50:39Z,direct_url=<?>,disk_format='qcow2',id=f1bbac86-d836-4690-9bee-04adeac6d7b2,min_disk=0,min_ram=0,name='tempest-scenario-img--86375829',owner='eab83b1fb4d343d08be479f5c56eb843',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:50:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'f1bbac86-d836-4690-9bee-04adeac6d7b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:50:44 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:50:44 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:50:39Z,direct_url=<?>,disk_format='qcow2',id=f1bbac86-d836-4690-9bee-04adeac6d7b2,min_disk=0,min_ram=0,name='tempest-scenario-img--86375829',owner='eab83b1fb4d343d08be479f5c56eb843',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:50:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1202134961',display_name='tempest-TestMinimumBasicScenario-server-1202134961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1202134961',id=39,image_ref='f1bbac86-d836-4690-9bee-04adeac6d7b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwr75etbHF+GYds2/A6+gBwWdRTwm8MGKYg9y2FynwipKbIjrwrc2ixUeuLeartyCa5D4y6LmpWL9kw7B+jDZtmSxI59D2d+px5fYGvvdVQLTZMKnoDIO1LFYVDsYZ1bg==',key_name='tempest-TestMinimumBasicScenario-551576560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eab83b1fb4d343d08be479f5c56eb843',ramdisk_id='',reservation_id='r-7ffi30vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bbac86-d836-4690-9bee-04adeac6d7b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-641847724',owner_user_name='tempest-TestMinimumBasicScenario-641847724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:50:43Z,user_data=None,user_id='6f68adc47ff640f6ae433684f457db57',uuid=aed2e3da-04aa-4ae0-976b-48c036666ec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converting VIF {"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.objects.instance [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'pci_devices' on Instance uuid aed2e3da-04aa-4ae0-976b-48c036666ec7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:50:44 user nova-compute[80928]:   <uuid>aed2e3da-04aa-4ae0-976b-48c036666ec7</uuid>
Nov 16 05:50:44 user nova-compute[80928]:   <name>instance-00000027</name>
Nov 16 05:50:44 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:50:44 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:50:44 user nova-compute[80928]:   <metadata>
Nov 16 05:50:44 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:50:44 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:50:44 user nova-compute[80928]:       <nova:name>tempest-TestMinimumBasicScenario-server-1202134961</nova:name>
Nov 16 05:50:44 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:50:44</nova:creationTime>
Nov 16 05:50:44 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:50:44 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:50:44 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:50:44 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:50:44 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:50:44 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:50:44 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:50:44 user nova-compute[80928]:       <nova:owner>
Nov 16 05:50:44 user nova-compute[80928]:         <nova:user uuid="6f68adc47ff640f6ae433684f457db57">tempest-TestMinimumBasicScenario-641847724-project-member</nova:user>
Nov 16 05:50:44 user nova-compute[80928]:         <nova:project uuid="eab83b1fb4d343d08be479f5c56eb843">tempest-TestMinimumBasicScenario-641847724</nova:project>
Nov 16 05:50:44 user nova-compute[80928]:       </nova:owner>
Nov 16 05:50:44 user nova-compute[80928]:       <nova:root type="image" uuid="f1bbac86-d836-4690-9bee-04adeac6d7b2"/>
Nov 16 05:50:44 user nova-compute[80928]:       <nova:ports>
Nov 16 05:50:44 user nova-compute[80928]:         <nova:port uuid="7182f759-123a-4764-9949-767ac0f4ddb6">
Nov 16 05:50:44 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:50:44 user nova-compute[80928]:         </nova:port>
Nov 16 05:50:44 user nova-compute[80928]:       </nova:ports>
Nov 16 05:50:44 user nova-compute[80928]:     </nova:instance>
Nov 16 05:50:44 user nova-compute[80928]:   </metadata>
Nov 16 05:50:44 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:50:44 user nova-compute[80928]:     <system>
Nov 16 05:50:44 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:50:44 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:50:44 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:50:44 user nova-compute[80928]:       <entry name="serial">aed2e3da-04aa-4ae0-976b-48c036666ec7</entry>
Nov 16 05:50:44 user nova-compute[80928]:       <entry name="uuid">aed2e3da-04aa-4ae0-976b-48c036666ec7</entry>
Nov 16 05:50:44 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:50:44 user nova-compute[80928]:     </system>
Nov 16 05:50:44 user nova-compute[80928]:   </sysinfo>
Nov 16 05:50:44 user nova-compute[80928]:   <os>
Nov 16 05:50:44 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:50:44 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:50:44 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:50:44 user nova-compute[80928]:   </os>
Nov 16 05:50:44 user nova-compute[80928]:   <features>
Nov 16 05:50:44 user nova-compute[80928]:     <acpi/>
Nov 16 05:50:44 user nova-compute[80928]:     <apic/>
Nov 16 05:50:44 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:50:44 user nova-compute[80928]:   </features>
Nov 16 05:50:44 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:50:44 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:50:44 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:50:44 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:50:44 user nova-compute[80928]:   </clock>
Nov 16 05:50:44 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:50:44 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:50:44 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:50:44 user nova-compute[80928]:   </cpu>
Nov 16 05:50:44 user nova-compute[80928]:   <devices>
Nov 16 05:50:44 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:50:44 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:50:44 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk"/>
Nov 16 05:50:44 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:50:44 user nova-compute[80928]:     </disk>
Nov 16 05:50:44 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:50:44 user nova-compute[80928]:       <mac address="fa:16:3e:41:fe:c3"/>
Nov 16 05:50:44 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:50:44 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:50:44 user nova-compute[80928]:       <target dev="tap7182f759-12"/>
Nov 16 05:50:44 user nova-compute[80928]:     </interface>
Nov 16 05:50:44 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:50:44 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/console.log" append="off"/>
Nov 16 05:50:44 user nova-compute[80928]:     </serial>
Nov 16 05:50:44 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:50:44 user nova-compute[80928]:     <video>
Nov 16 05:50:44 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:50:44 user nova-compute[80928]:     </video>
Nov 16 05:50:44 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:50:44 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:50:44 user nova-compute[80928]:     </rng>
Nov 16 05:50:44 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:50:44 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:50:44 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:50:44 user nova-compute[80928]:     </memballoon>
Nov 16 05:50:44 user nova-compute[80928]:   </devices>
Nov 16 05:50:44 user nova-compute[80928]: </domain>
Nov 16 05:50:44 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1202134961',display_name='tempest-TestMinimumBasicScenario-server-1202134961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1202134961',id=39,image_ref='f1bbac86-d836-4690-9bee-04adeac6d7b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwr75etbHF+GYds2/A6+gBwWdRTwm8MGKYg9y2FynwipKbIjrwrc2ixUeuLeartyCa5D4y6LmpWL9kw7B+jDZtmSxI59D2d+px5fYGvvdVQLTZMKnoDIO1LFYVDsYZ1bg==',key_name='tempest-TestMinimumBasicScenario-551576560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eab83b1fb4d343d08be479f5c56eb843',ramdisk_id='',reservation_id='r-7ffi30vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bbac86-d836-4690-9bee-04adeac6d7b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-641847724',owner_user_name='tempest-TestMinimumBasicScenario-641847724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:50:43Z,user_data=None,user_id='6f68adc47ff640f6ae433684f457db57',uuid=aed2e3da-04aa-4ae0-976b-48c036666ec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converting VIF {"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG os_vif [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70a5760d-bb54-5ffc-8e42-41a91a7b759f', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:50:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7182f759-12, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:50:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7182f759-12, col_values=(('qos', UUID('ee04980b-a9aa-4b22-81ca-aab421794976')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:50:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7182f759-12, col_values=(('external_ids', {'iface-id': '7182f759-123a-4764-9949-767ac0f4ddb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:fe:c3', 'vm-uuid': 'aed2e3da-04aa-4ae0-976b-48c036666ec7'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:50:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:50:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:45 user nova-compute[80928]: INFO os_vif [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12')
Nov 16 05:50:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:50:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] No VIF found with MAC fa:16:3e:41:fe:c3, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:50:45 user nova-compute[80928]: DEBUG nova.network.neutron [req-4b519f13-0c5c-42e9-9041-4ceed1c246fd req-ebd48b45-6818-4b35-ace4-51183049bbfa service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updated VIF entry in instance network info cache for port 7182f759-123a-4764-9949-767ac0f4ddb6. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:50:45 user nova-compute[80928]: DEBUG nova.network.neutron [req-4b519f13-0c5c-42e9-9041-4ceed1c246fd req-ebd48b45-6818-4b35-ace4-51183049bbfa service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updating instance_info_cache with network_info: [{"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:50:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4b519f13-0c5c-42e9-9041-4ceed1c246fd req-ebd48b45-6818-4b35-ace4-51183049bbfa service nova] Releasing lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:50:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-06e41697-8206-4ff9-95a7-02d109ea5d7a req-4c09d786-ffc4-43ff-a73b-7b2d32020e5a service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:50:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-06e41697-8206-4ff9-95a7-02d109ea5d7a req-4c09d786-ffc4-43ff-a73b-7b2d32020e5a service nova] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-06e41697-8206-4ff9-95a7-02d109ea5d7a req-4c09d786-ffc4-43ff-a73b-7b2d32020e5a service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-06e41697-8206-4ff9-95a7-02d109ea5d7a req-4c09d786-ffc4-43ff-a73b-7b2d32020e5a service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-06e41697-8206-4ff9-95a7-02d109ea5d7a req-4c09d786-ffc4-43ff-a73b-7b2d32020e5a service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] No waiting events found dispatching network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:50:46 user nova-compute[80928]: WARNING nova.compute.manager [req-06e41697-8206-4ff9-95a7-02d109ea5d7a req-4c09d786-ffc4-43ff-a73b-7b2d32020e5a service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received unexpected event network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 for instance with vm_state building and task_state spawning.
Nov 16 05:50:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-4cda2db6-6778-475f-967d-d0b21776ab5b req-6ef53681-00a1-460a-aaf1-04e599890dec service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:50:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4cda2db6-6778-475f-967d-d0b21776ab5b req-6ef53681-00a1-460a-aaf1-04e599890dec service nova] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4cda2db6-6778-475f-967d-d0b21776ab5b req-6ef53681-00a1-460a-aaf1-04e599890dec service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4cda2db6-6778-475f-967d-d0b21776ab5b req-6ef53681-00a1-460a-aaf1-04e599890dec service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-4cda2db6-6778-475f-967d-d0b21776ab5b req-6ef53681-00a1-460a-aaf1-04e599890dec service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] No waiting events found dispatching network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:50:48 user nova-compute[80928]: WARNING nova.compute.manager [req-4cda2db6-6778-475f-967d-d0b21776ab5b req-6ef53681-00a1-460a-aaf1-04e599890dec service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received unexpected event network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 for instance with vm_state building and task_state spawning.
Nov 16 05:50:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:50:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:50:48 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Instance spawned successfully.
Nov 16 05:50:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:50:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:50:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:50:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:50:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:50:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:50:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:50:48 user nova-compute[80928]: INFO nova.compute.manager [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 16 05:50:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:50:48 user nova-compute[80928]: INFO nova.compute.manager [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Took 6.85 seconds to build instance.
Nov 16 05:50:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f514741-acef-431b-9f25-d19736b239ae tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.939s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:51 user nova-compute[80928]: DEBUG nova.compute.manager [req-0faca3c2-bb87-4173-84f5-eebda7800ac4 req-ceb865e1-5c1b-4204-940a-848cbc654a12 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-changed-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:50:51 user nova-compute[80928]: DEBUG nova.compute.manager [req-0faca3c2-bb87-4173-84f5-eebda7800ac4 req-ceb865e1-5c1b-4204-940a-848cbc654a12 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Refreshing instance network info cache due to event network-changed-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:50:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0faca3c2-bb87-4173-84f5-eebda7800ac4 req-ceb865e1-5c1b-4204-940a-848cbc654a12 service nova] Acquiring lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:50:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0faca3c2-bb87-4173-84f5-eebda7800ac4 req-ceb865e1-5c1b-4204-940a-848cbc654a12 service nova] Acquired lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:50:51 user nova-compute[80928]: DEBUG nova.network.neutron [req-0faca3c2-bb87-4173-84f5-eebda7800ac4 req-ceb865e1-5c1b-4204-940a-848cbc654a12 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Refreshing network info cache for port 7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:50:52 user nova-compute[80928]: DEBUG nova.network.neutron [req-0faca3c2-bb87-4173-84f5-eebda7800ac4 req-ceb865e1-5c1b-4204-940a-848cbc654a12 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updated VIF entry in instance network info cache for port 7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:50:52 user nova-compute[80928]: DEBUG nova.network.neutron [req-0faca3c2-bb87-4173-84f5-eebda7800ac4 req-ceb865e1-5c1b-4204-940a-848cbc654a12 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updating instance_info_cache with network_info: [{"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:50:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0faca3c2-bb87-4173-84f5-eebda7800ac4 req-ceb865e1-5c1b-4204-940a-848cbc654a12 service nova] Releasing lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG nova.objects.instance [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:50:54 user nova-compute[80928]: INFO nova.compute.manager [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Attaching volume 0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 to /dev/vdb
Nov 16 05:50:54 user nova-compute[80928]: DEBUG os_brick.utils [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d03c390-7001-43ae-9776-d8b582d5c3c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e135817-90ed-4dff-8225-b889651bae08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[764ff512-f7f1-481b-bf11-574e5b3cbdc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4ab079-a419-454f-b6b4-d9c27cec02d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:50:54 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:50:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9c1465-90d0-4e78-93ef-108256ebc1d4]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG os_brick.utils [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:50:54 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updating existing volume attachment record: 264f75e5-74d5-44ba-a535-42d680c09a02 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:50:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBIcNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:50:59 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:50:59 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:50:59 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7127591-a183-4f66-91d9-4e67b0148f01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:50:59 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaf7f16-1636-4d8b-9681-be8c36868bcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2] added
Nov 16 05:50:59 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f1b5a0-a03c-4547-943a-5038a9ca854b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdbbbc0-df83-4fa6-8102-2d0e0bd71a24]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQBIcNCW {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQBIcNCW" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36acece-3365-49fb-ba66-f3b8e4865c63]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yQBIcNCW'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbefcbc-fdfc-4950-a180-f679f5da3b2d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24db829-f6d0-45d2-a6ad-ed7013882711]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:50:59 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:50:59 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:50:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1718fb2d-2202-4ce3-803e-ec93470314b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260]
Nov 16 05:51:00 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260] successful.
Nov 16 05:51:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[44473682-0b01-42c5-9625-edba5fad68db]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[35391426-777f-41d5-a8f2-debad8c57772]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:51:00 user nova-compute[80928]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:51:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:51:00 user nova-compute[80928]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:51:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b544305-3920-40df-b421-b3aaa18826d4]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:51:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBIcNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:51:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:51:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23662313763656430', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:51:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662313763656430', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:51:01 user nova-compute[80928]: DEBUG nova.objects.instance [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:51:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:51:01 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:51:01 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 05:51:01 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:51:01 user nova-compute[80928]:   <serial>0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2</serial>
Nov 16 05:51:01 user nova-compute[80928]: </disk>
Nov 16 05:51:01 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:51:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:51:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:51:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No VIF found with MAC fa:16:3e:86:53:a9, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:51:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-69319cf0-b8cc-4298-90d8-70eafa3c6f9f tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.926s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d905e2d9-ce76-4ba2-a717-e1af8ef214b5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d905e2d9-ce76-4ba2-a717-e1af8ef214b5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d905e2d9-ce76-4ba2-a717-e1af8ef214b5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d905e2d9-ce76-4ba2-a717-e1af8ef214b5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=80928) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG nova.objects.instance [None req-d905e2d9-ce76-4ba2-a717-e1af8ef214b5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-817e6c38-d480-4bcd-8591-cabcd2d1c688 req-12c8d785-b231-41ed-862a-d1c9dc05fb4f service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-unplugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-817e6c38-d480-4bcd-8591-cabcd2d1c688 req-12c8d785-b231-41ed-862a-d1c9dc05fb4f service nova] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-817e6c38-d480-4bcd-8591-cabcd2d1c688 req-12c8d785-b231-41ed-862a-d1c9dc05fb4f service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:51:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-817e6c38-d480-4bcd-8591-cabcd2d1c688 req-12c8d785-b231-41ed-862a-d1c9dc05fb4f service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:51:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-817e6c38-d480-4bcd-8591-cabcd2d1c688 req-12c8d785-b231-41ed-862a-d1c9dc05fb4f service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] No waiting events found dispatching network-vif-unplugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:51:03 user nova-compute[80928]: WARNING nova.compute.manager [req-817e6c38-d480-4bcd-8591-cabcd2d1c688 req-12c8d785-b231-41ed-862a-d1c9dc05fb4f service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received unexpected event network-vif-unplugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 for instance with vm_state active and task_state powering-off.
Nov 16 05:51:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:03 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance destroyed successfully.
Nov 16 05:51:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d905e2d9-ce76-4ba2-a717-e1af8ef214b5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:51:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d905e2d9-ce76-4ba2-a717-e1af8ef214b5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.884s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:51:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:05 user nova-compute[80928]: DEBUG nova.compute.manager [req-3af30a2e-07fe-423f-9052-2f2664660224 req-f39d839e-61d2-4879-93b6-5fe523f36925 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:51:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3af30a2e-07fe-423f-9052-2f2664660224 req-f39d839e-61d2-4879-93b6-5fe523f36925 service nova] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:51:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3af30a2e-07fe-423f-9052-2f2664660224 req-f39d839e-61d2-4879-93b6-5fe523f36925 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:51:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3af30a2e-07fe-423f-9052-2f2664660224 req-f39d839e-61d2-4879-93b6-5fe523f36925 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:51:05 user nova-compute[80928]: DEBUG nova.compute.manager [req-3af30a2e-07fe-423f-9052-2f2664660224 req-f39d839e-61d2-4879-93b6-5fe523f36925 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] No waiting events found dispatching network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:51:05 user nova-compute[80928]: WARNING nova.compute.manager [req-3af30a2e-07fe-423f-9052-2f2664660224 req-f39d839e-61d2-4879-93b6-5fe523f36925 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received unexpected event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 for instance with vm_state stopped and task_state None.
Nov 16 05:51:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:51:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "98701a69-085d-44f5-8eb0-effd8917f6b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:51:07 user nova-compute[80928]: INFO nova.compute.manager [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Terminating instance
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-ea4e709e-73dd-4e8e-aa33-196099d26633 req-6302603f-eade-4f68-a889-fb0fc19dfeee service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Received event network-changed-4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-ea4e709e-73dd-4e8e-aa33-196099d26633 req-6302603f-eade-4f68-a889-fb0fc19dfeee service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Refreshing instance network info cache due to event network-changed-4e39500a-73df-4081-923c-e7e8913ee64c. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ea4e709e-73dd-4e8e-aa33-196099d26633 req-6302603f-eade-4f68-a889-fb0fc19dfeee service nova] Acquiring lock "refresh_cache-98701a69-085d-44f5-8eb0-effd8917f6b5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ea4e709e-73dd-4e8e-aa33-196099d26633 req-6302603f-eade-4f68-a889-fb0fc19dfeee service nova] Acquired lock "refresh_cache-98701a69-085d-44f5-8eb0-effd8917f6b5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.network.neutron [req-ea4e709e-73dd-4e8e-aa33-196099d26633 req-6302603f-eade-4f68-a889-fb0fc19dfeee service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Refreshing network info cache for port 4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-04d75bbb-b91f-471d-9c65-e2479b52b8c4 req-d8cab1f7-bee3-4397-aea2-08edbb53c5c1 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Received event network-vif-unplugged-4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-04d75bbb-b91f-471d-9c65-e2479b52b8c4 req-d8cab1f7-bee3-4397-aea2-08edbb53c5c1 service nova] Acquiring lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-04d75bbb-b91f-471d-9c65-e2479b52b8c4 req-d8cab1f7-bee3-4397-aea2-08edbb53c5c1 service nova] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-04d75bbb-b91f-471d-9c65-e2479b52b8c4 req-d8cab1f7-bee3-4397-aea2-08edbb53c5c1 service nova] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-04d75bbb-b91f-471d-9c65-e2479b52b8c4 req-d8cab1f7-bee3-4397-aea2-08edbb53c5c1 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] No waiting events found dispatching network-vif-unplugged-4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-04d75bbb-b91f-471d-9c65-e2479b52b8c4 req-d8cab1f7-bee3-4397-aea2-08edbb53c5c1 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Received event network-vif-unplugged-4e39500a-73df-4081-923c-e7e8913ee64c for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.network.neutron [req-ea4e709e-73dd-4e8e-aa33-196099d26633 req-6302603f-eade-4f68-a889-fb0fc19dfeee service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Updated VIF entry in instance network info cache for port 4e39500a-73df-4081-923c-e7e8913ee64c. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.network.neutron [req-ea4e709e-73dd-4e8e-aa33-196099d26633 req-6302603f-eade-4f68-a889-fb0fc19dfeee service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Updating instance_info_cache with network_info: [{"id": "4e39500a-73df-4081-923c-e7e8913ee64c", "address": "fa:16:3e:50:29:ec", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39500a-73", "ovs_interfaceid": "4e39500a-73df-4081-923c-e7e8913ee64c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ea4e709e-73dd-4e8e-aa33-196099d26633 req-6302603f-eade-4f68-a889-fb0fc19dfeee service nova] Releasing lock "refresh_cache-98701a69-085d-44f5-8eb0-effd8917f6b5" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:51:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Instance destroyed successfully.
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.objects.instance [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lazy-loading 'resources' on Instance uuid 98701a69-085d-44f5-8eb0-effd8917f6b5 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-678350903',display_name='tempest-TestStampPattern-server-678350903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-678350903',id=37,image_ref='298c8395-8dae-43fd-bc76-63444fc02a1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLePRgjoHIwwFRskFVbkQTWicFJVZFVV6bqATDh63kS8WDDVk64Iwjsbx3COtxGzWdYj0GjKmGqFYJIuK4jxb9Hg6TfWNymS23NQpVvyf/ukUCfHQ63gwGXdG4hy01fL/A==',key_name='tempest-TestStampPattern-637785610',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:48:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2303337fe174f93801f18cd074276ce',ramdisk_id='',reservation_id='r-dlvxw6jp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6cc61915-ab05-4f3c-80ff-b873ae3dc68a',image_min_disk='1',image_min_ram='0',image_owner_id='e2303337fe174f93801f18cd074276ce',image_owner_project_name='tempest-TestStampPattern-1909880958',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1909880958-project-member',image_user_id='ca7c6c355f6045b3b372b280e0f45293',owner_project_name='tempest-TestStampPattern-1909880958',owner_user_name='tempest-TestStampPattern-1909880958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:48:22Z,user_data=None,user_id='ca7c6c355f6045b3b372b280e0f45293',uuid=98701a69-085d-44f5-8eb0-effd8917f6b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e39500a-73df-4081-923c-e7e8913ee64c", "address": "fa:16:3e:50:29:ec", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39500a-73", "ovs_interfaceid": "4e39500a-73df-4081-923c-e7e8913ee64c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Converting VIF {"id": "4e39500a-73df-4081-923c-e7e8913ee64c", "address": "fa:16:3e:50:29:ec", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e39500a-73", "ovs_interfaceid": "4e39500a-73df-4081-923c-e7e8913ee64c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e39500a-73df-4081-923c-e7e8913ee64c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39500a-73') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG os_vif [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e39500a-73df-4081-923c-e7e8913ee64c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39500a-73') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e39500a-73, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f64e9daa-9eae-4da8-b8e1-15599311a1c2) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:07 user nova-compute[80928]: INFO os_vif [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:29:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e39500a-73df-4081-923c-e7e8913ee64c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e39500a-73')
Nov 16 05:51:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Deleting instance files /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5_del
Nov 16 05:51:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Deletion of /opt/stack/data/nova/instances/98701a69-085d-44f5-8eb0-effd8917f6b5_del complete
Nov 16 05:51:07 user nova-compute[80928]: INFO nova.compute.manager [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 16 05:51:07 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:51:07 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:51:08 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:51:08 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Took 0.40 seconds to deallocate network for instance.
Nov 16 05:51:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:51:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:51:08 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:51:08 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:51:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:51:08 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Deleted allocations for instance 98701a69-085d-44f5-8eb0-effd8917f6b5
Nov 16 05:51:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-93de1102-e4cb-4a24-af11-8b455b2ca1d2 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.779s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:51:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-42588638-649b-4c3a-b5ea-4f896ec491af req-18daa413-b0b7-4e81-9f7e-e83294db67e7 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Received event network-vif-deleted-4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:51:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-176d71ae-3215-4a91-9c68-c45ce4b1927f req-4c22815c-0ed6-497d-9b9a-fbaa20f7f709 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Received event network-vif-plugged-4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:51:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-176d71ae-3215-4a91-9c68-c45ce4b1927f req-4c22815c-0ed6-497d-9b9a-fbaa20f7f709 service nova] Acquiring lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:51:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-176d71ae-3215-4a91-9c68-c45ce4b1927f req-4c22815c-0ed6-497d-9b9a-fbaa20f7f709 service nova] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:51:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-176d71ae-3215-4a91-9c68-c45ce4b1927f req-4c22815c-0ed6-497d-9b9a-fbaa20f7f709 service nova] Lock "98701a69-085d-44f5-8eb0-effd8917f6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:51:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-176d71ae-3215-4a91-9c68-c45ce4b1927f req-4c22815c-0ed6-497d-9b9a-fbaa20f7f709 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] No waiting events found dispatching network-vif-plugged-4e39500a-73df-4081-923c-e7e8913ee64c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:51:09 user nova-compute[80928]: WARNING nova.compute.manager [req-176d71ae-3215-4a91-9c68-c45ce4b1927f req-4c22815c-0ed6-497d-9b9a-fbaa20f7f709 service nova] [instance: 98701a69-085d-44f5-8eb0-effd8917f6b5] Received unexpected event network-vif-plugged-4e39500a-73df-4081-923c-e7e8913ee64c for instance with vm_state deleted and task_state None.
Nov 16 05:51:09 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:51:09 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:51:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:51:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:11 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:51:11 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:51:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:13 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:51:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:51:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:51:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:51:13 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:51:14 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Updating instance_info_cache with network_info: [{"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:51:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:51:14 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:51:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:16 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:51:16 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:51:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:51:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:51:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:51:16 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:51:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:51:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:51:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:20 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:51:20 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:51:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8260MB free_disk=25.076374053955078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance aed2e3da-04aa-4ae0-976b-48c036666ec7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:51:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:51:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:26 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:51:26 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:51:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-9fc97642-2f5a-421d-bf26-d40774814060 req-957e4f8d-a12c-4fca-83f8-62874dfb8135 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-changed-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:51:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-9fc97642-2f5a-421d-bf26-d40774814060 req-957e4f8d-a12c-4fca-83f8-62874dfb8135 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Refreshing instance network info cache due to event network-changed-d5c7e129-4809-463e-b3c9-5091f165e8c5. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:51:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9fc97642-2f5a-421d-bf26-d40774814060 req-957e4f8d-a12c-4fca-83f8-62874dfb8135 service nova] Acquiring lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:51:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9fc97642-2f5a-421d-bf26-d40774814060 req-957e4f8d-a12c-4fca-83f8-62874dfb8135 service nova] Acquired lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:51:33 user nova-compute[80928]: DEBUG nova.network.neutron [req-9fc97642-2f5a-421d-bf26-d40774814060 req-957e4f8d-a12c-4fca-83f8-62874dfb8135 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Refreshing network info cache for port d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:51:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:51:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:51:33 user nova-compute[80928]: INFO nova.compute.manager [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Detaching volume b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a
Nov 16 05:51:33 user nova-compute[80928]: DEBUG nova.network.neutron [req-9fc97642-2f5a-421d-bf26-d40774814060 req-957e4f8d-a12c-4fca-83f8-62874dfb8135 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updated VIF entry in instance network info cache for port d5c7e129-4809-463e-b3c9-5091f165e8c5. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:51:33 user nova-compute[80928]: DEBUG nova.network.neutron [req-9fc97642-2f5a-421d-bf26-d40774814060 req-957e4f8d-a12c-4fca-83f8-62874dfb8135 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updating instance_info_cache with network_info: [{"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:51:33 user nova-compute[80928]: INFO nova.virt.block_device [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Attempting to driver detach volume b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a from mountpoint /dev/vdb
Nov 16 05:51:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9fc97642-2f5a-421d-bf26-d40774814060 req-957e4f8d-a12c-4fca-83f8-62874dfb8135 service nova] Releasing lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:51:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Attempting to detach device vdb from instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:51:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:51:33 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:51:33 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 05:51:33 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:51:33 user nova-compute[80928]:   <serial>b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a</serial>
Nov 16 05:51:33 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:51:33 user nova-compute[80928]: </disk>
Nov 16 05:51:33 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:51:33 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Successfully detached device vdb from instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 from the persistent domain config.
Nov 16 05:51:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:51:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:51:33 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:51:33 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 05:51:33 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:51:33 user nova-compute[80928]:   <serial>b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a</serial>
Nov 16 05:51:33 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 05:51:33 user nova-compute[80928]: </disk>
Nov 16 05:51:33 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:51:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:51:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-589d0c45-2420-4a46-a425-716e4fc11f8d req-fe0d8953-7d35-41ca-81e2-c87474e3f18a service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-changed-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:51:35 user nova-compute[80928]: DEBUG nova.compute.manager [req-589d0c45-2420-4a46-a425-716e4fc11f8d req-fe0d8953-7d35-41ca-81e2-c87474e3f18a service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Refreshing instance network info cache due to event network-changed-d5c7e129-4809-463e-b3c9-5091f165e8c5. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:51:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-589d0c45-2420-4a46-a425-716e4fc11f8d req-fe0d8953-7d35-41ca-81e2-c87474e3f18a service nova] Acquiring lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:51:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-589d0c45-2420-4a46-a425-716e4fc11f8d req-fe0d8953-7d35-41ca-81e2-c87474e3f18a service nova] Acquired lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:51:35 user nova-compute[80928]: DEBUG nova.network.neutron [req-589d0c45-2420-4a46-a425-716e4fc11f8d req-fe0d8953-7d35-41ca-81e2-c87474e3f18a service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Refreshing network info cache for port d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:51:35 user nova-compute[80928]: DEBUG nova.network.neutron [req-589d0c45-2420-4a46-a425-716e4fc11f8d req-fe0d8953-7d35-41ca-81e2-c87474e3f18a service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updated VIF entry in instance network info cache for port d5c7e129-4809-463e-b3c9-5091f165e8c5. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:51:35 user nova-compute[80928]: DEBUG nova.network.neutron [req-589d0c45-2420-4a46-a425-716e4fc11f8d req-fe0d8953-7d35-41ca-81e2-c87474e3f18a service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updating instance_info_cache with network_info: [{"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:51:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-589d0c45-2420-4a46-a425-716e4fc11f8d req-fe0d8953-7d35-41ca-81e2-c87474e3f18a service nova] Releasing lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:51:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:51:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:51:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:51:54 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 is timed out.
Nov 16 05:51:54 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Successfully detached device vdb from instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 from the live domain config.
Nov 16 05:51:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHGQUbkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:51:54 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4932f99b-552f-4517-a96a-c6a423777ddc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:51:54 user nova-compute[80928]: No targets found.
Nov 16 05:51:54 user nova-compute[80928]: iSNS:
Nov 16 05:51:54 user nova-compute[80928]: No targets found.
Nov 16 05:51:54 user nova-compute[80928]: STATIC:
Nov 16 05:51:54 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a
Nov 16 05:51:54 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:51:54 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:51:54 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2
Nov 16 05:51:54 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:51:54 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:51:54 user nova-compute[80928]: FIRMWARE:
Nov 16 05:51:54 user nova-compute[80928]: No targets found.
Nov 16 05:51:54 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:51:54 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:51:54 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25a2cb4-e4de-4e32-9ccf-171b4a6a4ae6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ed6687-79b9-4263-8fe6-27e7519e6b69]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:51:54 user nova-compute[80928]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:51:54 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a (non-flash)
Nov 16 05:51:54 user nova-compute[80928]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:51:54 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8658547250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c485d70e-db3a-4def-8e9f-c4c8d4ddcf06]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a522014c-406c-4e35-a3e9-7f37aaa2c781]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[270f3c27-3042-466b-8bf8-2e53adbf66e9]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[692758b2-f955-4ae6-b00d-d80c85dbdc66]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[252a9a6f-b087-45e5-b5b7-40c31121f48d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[984f03c2-925a-4f72-be43-72453e71c2fa]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a, portal: 172.16.0.220,3260]
Nov 16 05:51:54 user nova-compute[80928]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a, portal: 172.16.0.220,3260] successful.
Nov 16 05:51:54 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5af46b1-4ad5-4e80-8c6d-e88ce0f7b10a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d1875e-5fd7-4294-a898-6115ecfaf2c2]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] <== disconnect_volume: return (307ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:51:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:51:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'flavor' on Instance uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:51:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-628fb03a-a82a-49c8-b659-5bc3f4ab8be0 tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.569s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:51:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-887de287-a818-4839-99ed-4100a0a6894c req-0dd05a18-bffd-48a6-aa1d-441c057504c4 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Received event network-changed-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-887de287-a818-4839-99ed-4100a0a6894c req-0dd05a18-bffd-48a6-aa1d-441c057504c4 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Refreshing instance network info cache due to event network-changed-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-887de287-a818-4839-99ed-4100a0a6894c req-0dd05a18-bffd-48a6-aa1d-441c057504c4 service nova] Acquiring lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-887de287-a818-4839-99ed-4100a0a6894c req-0dd05a18-bffd-48a6-aa1d-441c057504c4 service nova] Acquired lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG nova.network.neutron [req-887de287-a818-4839-99ed-4100a0a6894c req-0dd05a18-bffd-48a6-aa1d-441c057504c4 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Refreshing network info cache for port 0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:02 user nova-compute[80928]: INFO nova.compute.manager [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Terminating instance
Nov 16 05:52:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG nova.network.neutron [req-887de287-a818-4839-99ed-4100a0a6894c req-0dd05a18-bffd-48a6-aa1d-441c057504c4 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Updated VIF entry in instance network info cache for port 0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG nova.network.neutron [req-887de287-a818-4839-99ed-4100a0a6894c req-0dd05a18-bffd-48a6-aa1d-441c057504c4 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Updating instance_info_cache with network_info: [{"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-887de287-a818-4839-99ed-4100a0a6894c req-0dd05a18-bffd-48a6-aa1d-441c057504c4 service nova] Releasing lock "refresh_cache-6cc61915-ab05-4f3c-80ff-b873ae3dc68a" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-688d16cf-dfa5-4084-a574-5d741230a2ba req-d388f1bb-9eb5-48db-901c-fb2af214a21e service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Received event network-vif-unplugged-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-688d16cf-dfa5-4084-a574-5d741230a2ba req-d388f1bb-9eb5-48db-901c-fb2af214a21e service nova] Acquiring lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-688d16cf-dfa5-4084-a574-5d741230a2ba req-d388f1bb-9eb5-48db-901c-fb2af214a21e service nova] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-688d16cf-dfa5-4084-a574-5d741230a2ba req-d388f1bb-9eb5-48db-901c-fb2af214a21e service nova] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-688d16cf-dfa5-4084-a574-5d741230a2ba req-d388f1bb-9eb5-48db-901c-fb2af214a21e service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] No waiting events found dispatching network-vif-unplugged-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-688d16cf-dfa5-4084-a574-5d741230a2ba req-d388f1bb-9eb5-48db-901c-fb2af214a21e service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Received event network-vif-unplugged-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:03 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Instance destroyed successfully.
Nov 16 05:52:03 user nova-compute[80928]: DEBUG nova.objects.instance [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lazy-loading 'resources' on Instance uuid 6cc61915-ab05-4f3c-80ff-b873ae3dc68a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1532977584',display_name='tempest-TestStampPattern-server-1532977584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1532977584',id=34,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLePRgjoHIwwFRskFVbkQTWicFJVZFVV6bqATDh63kS8WDDVk64Iwjsbx3COtxGzWdYj0GjKmGqFYJIuK4jxb9Hg6TfWNymS23NQpVvyf/ukUCfHQ63gwGXdG4hy01fL/A==',key_name='tempest-TestStampPattern-637785610',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2303337fe174f93801f18cd074276ce',ramdisk_id='',reservation_id='r-1k1djk01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1909880958',owner_user_name='tempest-TestStampPattern-1909880958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:48:12Z,user_data=None,user_id='ca7c6c355f6045b3b372b280e0f45293',uuid=6cc61915-ab05-4f3c-80ff-b873ae3dc68a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Converting VIF {"id": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "address": "fa:16:3e:40:c7:4b", "network": {"id": "81cbcb30-7979-4c9e-8b22-3243b03dbaaf", "bridge": "br-int", "label": "tempest-TestStampPattern-141739583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2303337fe174f93801f18cd074276ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7e5f13-e7", "ovs_interfaceid": "0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:c7:4b,bridge_name='br-int',has_traffic_filtering=True,id=0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7e5f13-e7') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG os_vif [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:c7:4b,bridge_name='br-int',has_traffic_filtering=True,id=0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7e5f13-e7') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b7e5f13-e7, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=323a0ec1-092f-4cd9-be96-5b5e7119e9f5) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:03 user nova-compute[80928]: INFO os_vif [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:c7:4b,bridge_name='br-int',has_traffic_filtering=True,id=0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c,network=Network(81cbcb30-7979-4c9e-8b22-3243b03dbaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7e5f13-e7')
Nov 16 05:52:03 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Deleting instance files /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a_del
Nov 16 05:52:03 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Deletion of /opt/stack/data/nova/instances/6cc61915-ab05-4f3c-80ff-b873ae3dc68a_del complete
Nov 16 05:52:03 user nova-compute[80928]: INFO nova.compute.manager [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 05:52:03 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:52:03 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:52:04 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:52:04 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Took 0.52 seconds to deallocate network for instance.
Nov 16 05:52:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-52ab14c4-d021-44b0-86e5-404ddb7feb6c req-e771fe56-d819-4183-8375-6c7c4c5dd20f service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Received event network-vif-deleted-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:04 user nova-compute[80928]: INFO nova.compute.manager [req-52ab14c4-d021-44b0-86e5-404ddb7feb6c req-e771fe56-d819-4183-8375-6c7c4c5dd20f service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Neutron deleted interface 0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c; detaching it from the instance and deleting it from the info cache
Nov 16 05:52:04 user nova-compute[80928]: DEBUG nova.network.neutron [req-52ab14c4-d021-44b0-86e5-404ddb7feb6c req-e771fe56-d819-4183-8375-6c7c4c5dd20f service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:52:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-52ab14c4-d021-44b0-86e5-404ddb7feb6c req-e771fe56-d819-4183-8375-6c7c4c5dd20f service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Detach interface failed, port_id=0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c, reason: Instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:52:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:04 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:52:04 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:52:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:04 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Deleted allocations for instance 6cc61915-ab05-4f3c-80ff-b873ae3dc68a
Nov 16 05:52:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d334a64-0439-42b0-82b0-7c2de3dc1ef9 tempest-TestStampPattern-1909880958 tempest-TestStampPattern-1909880958-project-member] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.812s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:05 user nova-compute[80928]: DEBUG nova.compute.manager [req-d16ea95d-8f3d-433f-8b7d-523d3b4b130e req-174f092c-7d4f-4b05-8bbf-0649bed193e1 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Received event network-vif-plugged-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d16ea95d-8f3d-433f-8b7d-523d3b4b130e req-174f092c-7d4f-4b05-8bbf-0649bed193e1 service nova] Acquiring lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d16ea95d-8f3d-433f-8b7d-523d3b4b130e req-174f092c-7d4f-4b05-8bbf-0649bed193e1 service nova] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d16ea95d-8f3d-433f-8b7d-523d3b4b130e req-174f092c-7d4f-4b05-8bbf-0649bed193e1 service nova] Lock "6cc61915-ab05-4f3c-80ff-b873ae3dc68a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:05 user nova-compute[80928]: DEBUG nova.compute.manager [req-d16ea95d-8f3d-433f-8b7d-523d3b4b130e req-174f092c-7d4f-4b05-8bbf-0649bed193e1 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] No waiting events found dispatching network-vif-plugged-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:52:05 user nova-compute[80928]: WARNING nova.compute.manager [req-d16ea95d-8f3d-433f-8b7d-523d3b4b130e req-174f092c-7d4f-4b05-8bbf-0649bed193e1 service nova] [instance: 6cc61915-ab05-4f3c-80ff-b873ae3dc68a] Received unexpected event network-vif-plugged-0b7e5f13-e79c-413f-8ee9-3b4fc8da4f4c for instance with vm_state deleted and task_state None.
Nov 16 05:52:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:52:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:52:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:52:11 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:52:12 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:52:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:52:14 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:52:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:52:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:52:14 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:52:15 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updating instance_info_cache with network_info: [{"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:52:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-f38bf2ae-3719-400f-9da0-dcfade8c6fd7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:52:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:52:17 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:52:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:18 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:52:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:18 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:52:18 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:52:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:52:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:52:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8595MB free_disk=25.19986343383789GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance aed2e3da-04aa-4ae0-976b-48c036666ec7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:52:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:24 user nova-compute[80928]: INFO nova.compute.manager [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Terminating instance
Nov 16 05:52:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-ea04c707-bc0a-4b86-bdbc-1ce870bea488 req-c4ffe1be-37cd-4824-bc4a-78fd8f515756 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-unplugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ea04c707-bc0a-4b86-bdbc-1ce870bea488 req-c4ffe1be-37cd-4824-bc4a-78fd8f515756 service nova] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ea04c707-bc0a-4b86-bdbc-1ce870bea488 req-c4ffe1be-37cd-4824-bc4a-78fd8f515756 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ea04c707-bc0a-4b86-bdbc-1ce870bea488 req-c4ffe1be-37cd-4824-bc4a-78fd8f515756 service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-ea04c707-bc0a-4b86-bdbc-1ce870bea488 req-c4ffe1be-37cd-4824-bc4a-78fd8f515756 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] No waiting events found dispatching network-vif-unplugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-ea04c707-bc0a-4b86-bdbc-1ce870bea488 req-c4ffe1be-37cd-4824-bc4a-78fd8f515756 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-unplugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:24 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Instance destroyed successfully.
Nov 16 05:52:24 user nova-compute[80928]: DEBUG nova.objects.instance [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'resources' on Instance uuid f38bf2ae-3719-400f-9da0-dcfade8c6fd7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-862455296',display_name='tempest-ServerRescueNegativeTestJSON-server-862455296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-862455296',id=35,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkw5iCaKuOS7IO2Sp9Heoc9mgZtHIGvE/j7xHdnGD10/NqBa38q9r3At6EKN4fK/8sUZl11uX5NLPj1Y3OV/R6Md0dVYQok4USN7TvyvaboDEqgtO3EVj0eWlt2HqmVCg==',key_name='tempest-keypair-984127359',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:47:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8820092d2a4d50ab092ac90e5e1d3d',ramdisk_id='',reservation_id='r-9c1an6p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-575506684',owner_user_name='tempest-ServerRescueNegativeTestJSON-575506684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:49:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ade947942acc48ef940224970f670985',uuid=f38bf2ae-3719-400f-9da0-dcfade8c6fd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converting VIF {"id": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "address": "fa:16:3e:b2:65:29", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c7e129-48", "ovs_interfaceid": "d5c7e129-4809-463e-b3c9-5091f165e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:65:29,bridge_name='br-int',has_traffic_filtering=True,id=d5c7e129-4809-463e-b3c9-5091f165e8c5,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c7e129-48') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG os_vif [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:65:29,bridge_name='br-int',has_traffic_filtering=True,id=d5c7e129-4809-463e-b3c9-5091f165e8c5,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c7e129-48') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5c7e129-48, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78054c49-3cc7-40fe-b0d1-644ade483b7e) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:24 user nova-compute[80928]: INFO os_vif [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:65:29,bridge_name='br-int',has_traffic_filtering=True,id=d5c7e129-4809-463e-b3c9-5091f165e8c5,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c7e129-48')
Nov 16 05:52:24 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Deleting instance files /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7_del
Nov 16 05:52:24 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Deletion of /opt/stack/data/nova/instances/f38bf2ae-3719-400f-9da0-dcfade8c6fd7_del complete
Nov 16 05:52:24 user nova-compute[80928]: INFO nova.compute.manager [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 05:52:24 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:52:24 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:52:25 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:52:25 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Took 0.70 seconds to deallocate network for instance.
Nov 16 05:52:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-aad56c6d-9f04-4561-8a00-84f9ad70fe0b req-70b98581-15f9-4dd4-9a8c-cf8973695f98 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-deleted-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:25 user nova-compute[80928]: INFO nova.compute.manager [req-aad56c6d-9f04-4561-8a00-84f9ad70fe0b req-70b98581-15f9-4dd4-9a8c-cf8973695f98 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Neutron deleted interface d5c7e129-4809-463e-b3c9-5091f165e8c5; detaching it from the instance and deleting it from the info cache
Nov 16 05:52:25 user nova-compute[80928]: DEBUG nova.network.neutron [req-aad56c6d-9f04-4561-8a00-84f9ad70fe0b req-70b98581-15f9-4dd4-9a8c-cf8973695f98 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:52:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-aad56c6d-9f04-4561-8a00-84f9ad70fe0b req-70b98581-15f9-4dd4-9a8c-cf8973695f98 service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Detach interface failed, port_id=d5c7e129-4809-463e-b3c9-5091f165e8c5, reason: Instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7 could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:52:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:25 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:52:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:52:25 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:52:25 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:52:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:25 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Deleted allocations for instance f38bf2ae-3719-400f-9da0-dcfade8c6fd7
Nov 16 05:52:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a9ff7039-a472-4d19-a659-6f811951364a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.928s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe91e02a-6c4c-4b3e-8543-92dc8bb88e41 req-c1f0c7cf-4802-4d4e-a73a-65ba2eefb06b service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe91e02a-6c4c-4b3e-8543-92dc8bb88e41 req-c1f0c7cf-4802-4d4e-a73a-65ba2eefb06b service nova] Acquiring lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe91e02a-6c4c-4b3e-8543-92dc8bb88e41 req-c1f0c7cf-4802-4d4e-a73a-65ba2eefb06b service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-fe91e02a-6c4c-4b3e-8543-92dc8bb88e41 req-c1f0c7cf-4802-4d4e-a73a-65ba2eefb06b service nova] Lock "f38bf2ae-3719-400f-9da0-dcfade8c6fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-fe91e02a-6c4c-4b3e-8543-92dc8bb88e41 req-c1f0c7cf-4802-4d4e-a73a-65ba2eefb06b service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] No waiting events found dispatching network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:52:26 user nova-compute[80928]: WARNING nova.compute.manager [req-fe91e02a-6c4c-4b3e-8543-92dc8bb88e41 req-c1f0c7cf-4802-4d4e-a73a-65ba2eefb06b service nova] [instance: f38bf2ae-3719-400f-9da0-dcfade8c6fd7] Received unexpected event network-vif-plugged-d5c7e129-4809-463e-b3c9-5091f165e8c5 for instance with vm_state deleted and task_state None.
Nov 16 05:52:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG nova.objects.instance [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'flavor' on Instance uuid aed2e3da-04aa-4ae0-976b-48c036666ec7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:34 user nova-compute[80928]: INFO nova.compute.manager [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Attaching volume 317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f to /dev/vdb
Nov 16 05:52:34 user nova-compute[80928]: DEBUG os_brick.utils [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6725859-ff07-4dcd-9f2a-ea0c5f4f5575]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dbb543-dab7-4ef3-ace2-c4a51344bc34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba587265-98d4-4736-93ee-2fc9d1d83a15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27ba438-cacb-4b98-b8af-9cb76cac27b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:52:34 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:52:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6b95e5-2108-48f5-9e38-8227a6591434]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG os_brick.utils [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updating existing volume attachment record: a82fcd31-7661-43fe-b47e-1d5c595f3e77 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:52:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaAmRhiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:52:39 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:52:39 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:52:39 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2a6fe3-e0f2-4585-a565-a266496c8e64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:52:39 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecec4d4-686c-4c91-a635-97472192a484]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f] added
Nov 16 05:52:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[496d29ce-8c2c-467c-a4c7-9df86e8b3470]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5484b777-97cc-4468-aa8d-1eb9651d525a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QaAmRhiC {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QaAmRhiC" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c3fdd0-b766-4ba1-a940-94b1b09c1628]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QaAmRhiC'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e660cc8b-253b-4f9c-86b9-2a02e1e82a58]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af4433f-7128-40c8-8396-5eaf4f0f4073]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c325bc32-5ad5-49d9-bdd9-f194c478f9ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260]
Nov 16 05:52:39 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260] successful.
Nov 16 05:52:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9935f4df-7e2b-4ebe-8804-5123c61da0a7]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3434805-05b5-4d59-b78a-116417b214ec]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:39 user nova-compute[80928]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:52:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:39 user nova-compute[80928]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:52:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8508a02e-ed11-4fc0-a6a5-6b14395f2071]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:52:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:40 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:52:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaAmRhiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:52:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:52:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26233626237623863', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:52:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233626237623863', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:52:40 user nova-compute[80928]: DEBUG nova.objects.instance [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'flavor' on Instance uuid aed2e3da-04aa-4ae0-976b-48c036666ec7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:52:40 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:52:40 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 05:52:40 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:52:40 user nova-compute[80928]:   <serial>317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f</serial>
Nov 16 05:52:40 user nova-compute[80928]: </disk>
Nov 16 05:52:40 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:52:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:52:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:52:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] No VIF found with MAC fa:16:3e:41:fe:c3, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:52:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b6376674-94a1-4bc9-a745-9615ba5e7617 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.790s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-336afe60-7165-4f34-9d6e-0435ff8faad0 req-aa53e753-3f21-43c7-8a0b-9051dc181371 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-changed-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-336afe60-7165-4f34-9d6e-0435ff8faad0 req-aa53e753-3f21-43c7-8a0b-9051dc181371 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Refreshing instance network info cache due to event network-changed-7182f759-123a-4764-9949-767ac0f4ddb6. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:52:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-336afe60-7165-4f34-9d6e-0435ff8faad0 req-aa53e753-3f21-43c7-8a0b-9051dc181371 service nova] Acquiring lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:52:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-336afe60-7165-4f34-9d6e-0435ff8faad0 req-aa53e753-3f21-43c7-8a0b-9051dc181371 service nova] Acquired lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:52:46 user nova-compute[80928]: DEBUG nova.network.neutron [req-336afe60-7165-4f34-9d6e-0435ff8faad0 req-aa53e753-3f21-43c7-8a0b-9051dc181371 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Refreshing network info cache for port 7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:52:47 user nova-compute[80928]: DEBUG nova.network.neutron [req-336afe60-7165-4f34-9d6e-0435ff8faad0 req-aa53e753-3f21-43c7-8a0b-9051dc181371 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updated VIF entry in instance network info cache for port 7182f759-123a-4764-9949-767ac0f4ddb6. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:52:47 user nova-compute[80928]: DEBUG nova.network.neutron [req-336afe60-7165-4f34-9d6e-0435ff8faad0 req-aa53e753-3f21-43c7-8a0b-9051dc181371 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updating instance_info_cache with network_info: [{"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:52:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-336afe60-7165-4f34-9d6e-0435ff8faad0 req-aa53e753-3f21-43c7-8a0b-9051dc181371 service nova] Releasing lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:52:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-d247e3db-60a6-4e91-a918-16235fa464dc req-d8f3fc4f-9d55-4b7d-b037-25ffc98c478b service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-changed-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-d247e3db-60a6-4e91-a918-16235fa464dc req-d8f3fc4f-9d55-4b7d-b037-25ffc98c478b service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Refreshing instance network info cache due to event network-changed-7182f759-123a-4764-9949-767ac0f4ddb6. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:52:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d247e3db-60a6-4e91-a918-16235fa464dc req-d8f3fc4f-9d55-4b7d-b037-25ffc98c478b service nova] Acquiring lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:52:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d247e3db-60a6-4e91-a918-16235fa464dc req-d8f3fc4f-9d55-4b7d-b037-25ffc98c478b service nova] Acquired lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:52:48 user nova-compute[80928]: DEBUG nova.network.neutron [req-d247e3db-60a6-4e91-a918-16235fa464dc req-d8f3fc4f-9d55-4b7d-b037-25ffc98c478b service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Refreshing network info cache for port 7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:52:49 user nova-compute[80928]: DEBUG nova.network.neutron [req-d247e3db-60a6-4e91-a918-16235fa464dc req-d8f3fc4f-9d55-4b7d-b037-25ffc98c478b service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updated VIF entry in instance network info cache for port 7182f759-123a-4764-9949-767ac0f4ddb6. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:52:49 user nova-compute[80928]: DEBUG nova.network.neutron [req-d247e3db-60a6-4e91-a918-16235fa464dc req-d8f3fc4f-9d55-4b7d-b037-25ffc98c478b service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updating instance_info_cache with network_info: [{"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:52:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d247e3db-60a6-4e91-a918-16235fa464dc req-d8f3fc4f-9d55-4b7d-b037-25ffc98c478b service nova] Releasing lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:52:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:52 user nova-compute[80928]: INFO nova.compute.manager [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Rebooting instance
Nov 16 05:52:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:52:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquired lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:52:52 user nova-compute[80928]: DEBUG nova.network.neutron [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:52:52 user nova-compute[80928]: DEBUG nova.network.neutron [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updating instance_info_cache with network_info: [{"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:52:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Releasing lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:52:52 user nova-compute[80928]: DEBUG nova.compute.manager [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:52:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-a77a544a-f038-43c1-bb2f-2a3c5b912098 req-63f5b3aa-8f69-4673-ac25-2bcfd71eb41d service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-vif-unplugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a77a544a-f038-43c1-bb2f-2a3c5b912098 req-63f5b3aa-8f69-4673-ac25-2bcfd71eb41d service nova] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a77a544a-f038-43c1-bb2f-2a3c5b912098 req-63f5b3aa-8f69-4673-ac25-2bcfd71eb41d service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a77a544a-f038-43c1-bb2f-2a3c5b912098 req-63f5b3aa-8f69-4673-ac25-2bcfd71eb41d service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.compute.manager [req-a77a544a-f038-43c1-bb2f-2a3c5b912098 req-63f5b3aa-8f69-4673-ac25-2bcfd71eb41d service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] No waiting events found dispatching network-vif-unplugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:52:53 user nova-compute[80928]: WARNING nova.compute.manager [req-a77a544a-f038-43c1-bb2f-2a3c5b912098 req-63f5b3aa-8f69-4673-ac25-2bcfd71eb41d service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received unexpected event network-vif-unplugged-7182f759-123a-4764-9949-767ac0f4ddb6 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquired lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'info_cache' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.objects.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:52:53 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Instance destroyed successfully.
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.objects.instance [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'resources' on Instance uuid aed2e3da-04aa-4ae0-976b-48c036666ec7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1202134961',display_name='tempest-TestMinimumBasicScenario-server-1202134961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1202134961',id=39,image_ref='f1bbac86-d836-4690-9bee-04adeac6d7b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwr75etbHF+GYds2/A6+gBwWdRTwm8MGKYg9y2FynwipKbIjrwrc2ixUeuLeartyCa5D4y6LmpWL9kw7B+jDZtmSxI59D2d+px5fYGvvdVQLTZMKnoDIO1LFYVDsYZ1bg==',key_name='tempest-TestMinimumBasicScenario-551576560',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:50:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eab83b1fb4d343d08be479f5c56eb843',ramdisk_id='',reservation_id='r-7ffi30vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bbac86-d836-4690-9bee-04adeac6d7b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-641847724',owner_user_name='tempest-TestMinimumBasicScenario-641847724-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:52:53Z,user_data=None,user_id='6f68adc47ff640f6ae433684f457db57',uuid=aed2e3da-04aa-4ae0-976b-48c036666ec7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converting VIF {"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_vif [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7182f759-12, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee04980b-a9aa-4b22-81ca-aab421794976) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:53 user nova-compute[80928]: INFO os_vif [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12')
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaAmRhiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:52:53 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e51cf53-61d5-46a9-a0f7-119a3d9d3e99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:52:53 user nova-compute[80928]: No targets found.
Nov 16 05:52:53 user nova-compute[80928]: iSNS:
Nov 16 05:52:53 user nova-compute[80928]: No targets found.
Nov 16 05:52:53 user nova-compute[80928]: STATIC:
Nov 16 05:52:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2
Nov 16 05:52:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:52:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:52:53 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f
Nov 16 05:52:53 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:52:53 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:52:53 user nova-compute[80928]: FIRMWARE:
Nov 16 05:52:53 user nova-compute[80928]: No targets found.
Nov 16 05:52:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:52:53 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:52:53 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5341fb29-504c-4e0e-8c7f-dd46ec060548]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd24634b-698d-494a-a9fa-56fda3ba9efd]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:53 user nova-compute[80928]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:52:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:53 user nova-compute[80928]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:52:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a5120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3b37fd-7e83-4650-9619-6ebc44f8c458]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3072210f-ef36-48cb-be91-8df437d62fbe]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[674eac2b-8765-458f-a497-80d309cf9d42]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[77532606-2cd7-4b4e-b195-c853681bd74a]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dc0b8a-eb35-4ee0-ab33-ab3326ba3256]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2695b6c8-ee65-46bc-8b77-a2b599feebfe]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260]
Nov 16 05:52:53 user nova-compute[80928]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260] successful.
Nov 16 05:52:53 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c46715-acfe-42bd-9320-6b11ada312ac]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] <== disconnect_volume: return (283ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Start _get_guest_xml network_info=[{"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1bbac86-d836-4690-9bee-04adeac6d7b2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'f1bbac86-d836-4690-9bee-04adeac6d7b2'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaAmRhiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'aed2e3da-04aa-4ae0-976b-48c036666ec7', 'attached_at': '', 'detached_at': '', 'volume_id': '317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f', 'serial': '317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a82fcd31-7661-43fe-b47e-1d5c595f3e77', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:52:53 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:52:53 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1bbac86-d836-4690-9bee-04adeac6d7b2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.objects.instance [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'vcpu_model' on Instance uuid aed2e3da-04aa-4ae0-976b-48c036666ec7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.objects.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Object Instance<aed2e3da-04aa-4ae0-976b-48c036666ec7> lazy-loaded attributes: resources,vcpu_model {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaAmRhiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:52:53 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:52:53 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:52:53 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:52:53 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updating instance_info_cache with network_info: [{"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Releasing lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9062421-dfeb-4c78-ab78-089535cd5487]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:53 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:52:53 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:54 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance destroyed successfully.
Nov 16 05:52:54 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'resources' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22517d9-d200-4097-af0d-bc964bef93ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f] added
Nov 16 05:52:54 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG nova.objects.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache,resources {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1608335381',display_name='tempest-AttachVolumeTestJSON-server-1608335381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1608335381',id=38,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIheiaIxPwP6SA4L1FNfT/iVP2oIcKbZWevRs6N7x4qvsfqzxVVfO6fF8zGk5rw0ndDEv99BxFLQjD1+Tt+oqfeijNH8TrsvSWOfBX1YC4BXEZkch1QPW+6pCo5Kkt1+w==',key_name='tempest-keypair-845255928',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05d6e74da88a497ca920dcb2e07ea05a',ramdisk_id='',reservation_id='r-yk964sbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1530907565',owner_user_name='tempest-AttachVolumeTestJSON-1530907565-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be30aca2412b475498f99dddb86c5983',uuid=35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converting VIF {"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_vif [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7453ccbb-c8, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1202229-6c43-422a-87da-c87b6175fa15]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c574da88-07d6-4b1c-a4e1-1c5422713caf) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:54 user nova-compute[80928]: INFO os_vif [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8')
Nov 16 05:52:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBIcNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:52:54 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49cc506-8e27-434c-97b4-c7a3ca4a6169]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QaAmRhiC {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QaAmRhiC" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccf85e4-4af1-4d81-98aa-8ef69af9c661]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QaAmRhiC'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d047581-e443-48f1-9f0b-ab33fc68c42d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab3eca6-1958-47c4-9739-bc0ec4fb9cda]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:54 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:54 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd1f147-6b6c-471f-b360-4b519c9ccb59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260]
Nov 16 05:52:54 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260] successful.
Nov 16 05:52:54 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c7d6b8-97ac-43ce-98e9-3f723e0811a4]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9713d8-e68a-4cf3-91c4-9f32f327e003]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:54 user nova-compute[80928]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:52:54 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:54 user nova-compute[80928]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:52:54 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a73712-67e1-446e-b1fa-41135197d6c6]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:52:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaAmRhiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26233626237623863', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233626237623863', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.233s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[344ca13f-15ba-44ce-8a92-d67e8b47195f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:52:55 user nova-compute[80928]: No targets found.
Nov 16 05:52:55 user nova-compute[80928]: iSNS:
Nov 16 05:52:55 user nova-compute[80928]: No targets found.
Nov 16 05:52:55 user nova-compute[80928]: STATIC:
Nov 16 05:52:55 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2
Nov 16 05:52:55 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:52:55 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:52:55 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f
Nov 16 05:52:55 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:52:55 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:52:55 user nova-compute[80928]: FIRMWARE:
Nov 16 05:52:55 user nova-compute[80928]: No targets found.
Nov 16 05:52:55 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:52:55 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:52:55 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1202134961',display_name='tempest-TestMinimumBasicScenario-server-1202134961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1202134961',id=39,image_ref='f1bbac86-d836-4690-9bee-04adeac6d7b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwr75etbHF+GYds2/A6+gBwWdRTwm8MGKYg9y2FynwipKbIjrwrc2ixUeuLeartyCa5D4y6LmpWL9kw7B+jDZtmSxI59D2d+px5fYGvvdVQLTZMKnoDIO1LFYVDsYZ1bg==',key_name='tempest-TestMinimumBasicScenario-551576560',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:50:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eab83b1fb4d343d08be479f5c56eb843',ramdisk_id='',reservation_id='r-7ffi30vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bbac86-d836-4690-9bee-04adeac6d7b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-641847724',owner_user_name='tempest-TestMinimumBasicScenario-641847724-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:52:53Z,user_data=None,user_id='6f68adc47ff640f6ae433684f457db57',uuid=aed2e3da-04aa-4ae0-976b-48c036666ec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converting VIF {"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'pci_devices' on Instance uuid aed2e3da-04aa-4ae0-976b-48c036666ec7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-4bd44fbf-a481-4f6b-849c-0aceed786166 req-a40e5704-e489-44cb-9309-b5cdbd6813d9 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4bd44fbf-a481-4f6b-849c-0aceed786166 req-a40e5704-e489-44cb-9309-b5cdbd6813d9 service nova] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4bd44fbf-a481-4f6b-849c-0aceed786166 req-a40e5704-e489-44cb-9309-b5cdbd6813d9 service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4bd44fbf-a481-4f6b-849c-0aceed786166 req-a40e5704-e489-44cb-9309-b5cdbd6813d9 service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-4bd44fbf-a481-4f6b-849c-0aceed786166 req-a40e5704-e489-44cb-9309-b5cdbd6813d9 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] No waiting events found dispatching network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:52:55 user nova-compute[80928]: WARNING nova.compute.manager [req-4bd44fbf-a481-4f6b-849c-0aceed786166 req-a40e5704-e489-44cb-9309-b5cdbd6813d9 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received unexpected event network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.objects.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Object Instance<aed2e3da-04aa-4ae0-976b-48c036666ec7> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:52:55 user nova-compute[80928]:   <uuid>aed2e3da-04aa-4ae0-976b-48c036666ec7</uuid>
Nov 16 05:52:55 user nova-compute[80928]:   <name>instance-00000027</name>
Nov 16 05:52:55 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:52:55 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:52:55 user nova-compute[80928]:   <metadata>
Nov 16 05:52:55 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:52:55 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:52:55 user nova-compute[80928]:       <nova:name>tempest-TestMinimumBasicScenario-server-1202134961</nova:name>
Nov 16 05:52:55 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:52:53</nova:creationTime>
Nov 16 05:52:55 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:52:55 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:52:55 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:52:55 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:52:55 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:52:55 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:52:55 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:52:55 user nova-compute[80928]:       <nova:owner>
Nov 16 05:52:55 user nova-compute[80928]:         <nova:user uuid="6f68adc47ff640f6ae433684f457db57">tempest-TestMinimumBasicScenario-641847724-project-member</nova:user>
Nov 16 05:52:55 user nova-compute[80928]:         <nova:project uuid="eab83b1fb4d343d08be479f5c56eb843">tempest-TestMinimumBasicScenario-641847724</nova:project>
Nov 16 05:52:55 user nova-compute[80928]:       </nova:owner>
Nov 16 05:52:55 user nova-compute[80928]:       <nova:root type="image" uuid="f1bbac86-d836-4690-9bee-04adeac6d7b2"/>
Nov 16 05:52:55 user nova-compute[80928]:       <nova:ports>
Nov 16 05:52:55 user nova-compute[80928]:         <nova:port uuid="7182f759-123a-4764-9949-767ac0f4ddb6">
Nov 16 05:52:55 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 05:52:55 user nova-compute[80928]:         </nova:port>
Nov 16 05:52:55 user nova-compute[80928]:       </nova:ports>
Nov 16 05:52:55 user nova-compute[80928]:     </nova:instance>
Nov 16 05:52:55 user nova-compute[80928]:   </metadata>
Nov 16 05:52:55 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:52:55 user nova-compute[80928]:     <system>
Nov 16 05:52:55 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:52:55 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:52:55 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:52:55 user nova-compute[80928]:       <entry name="serial">aed2e3da-04aa-4ae0-976b-48c036666ec7</entry>
Nov 16 05:52:55 user nova-compute[80928]:       <entry name="uuid">aed2e3da-04aa-4ae0-976b-48c036666ec7</entry>
Nov 16 05:52:55 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:52:55 user nova-compute[80928]:     </system>
Nov 16 05:52:55 user nova-compute[80928]:   </sysinfo>
Nov 16 05:52:55 user nova-compute[80928]:   <os>
Nov 16 05:52:55 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:52:55 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:52:55 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:52:55 user nova-compute[80928]:   </os>
Nov 16 05:52:55 user nova-compute[80928]:   <features>
Nov 16 05:52:55 user nova-compute[80928]:     <acpi/>
Nov 16 05:52:55 user nova-compute[80928]:     <apic/>
Nov 16 05:52:55 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:52:55 user nova-compute[80928]:   </features>
Nov 16 05:52:55 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:52:55 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:52:55 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:52:55 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:52:55 user nova-compute[80928]:   </clock>
Nov 16 05:52:55 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:52:55 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:52:55 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:52:55 user nova-compute[80928]:   </cpu>
Nov 16 05:52:55 user nova-compute[80928]:   <devices>
Nov 16 05:52:55 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:52:55 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:52:55 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk"/>
Nov 16 05:52:55 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:52:55 user nova-compute[80928]:     </disk>
Nov 16 05:52:55 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:52:55 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:52:55 user nova-compute[80928]:       <source dev="/dev/sdc"/>
Nov 16 05:52:55 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:52:55 user nova-compute[80928]:       <serial>317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f</serial>
Nov 16 05:52:55 user nova-compute[80928]:     </disk>
Nov 16 05:52:55 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:52:55 user nova-compute[80928]:       <mac address="fa:16:3e:41:fe:c3"/>
Nov 16 05:52:55 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:52:55 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:52:55 user nova-compute[80928]:       <target dev="tap7182f759-12"/>
Nov 16 05:52:55 user nova-compute[80928]:     </interface>
Nov 16 05:52:55 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:52:55 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/console.log" append="off"/>
Nov 16 05:52:55 user nova-compute[80928]:     </serial>
Nov 16 05:52:55 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:52:55 user nova-compute[80928]:     <video>
Nov 16 05:52:55 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:52:55 user nova-compute[80928]:     </video>
Nov 16 05:52:55 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:52:55 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:52:55 user nova-compute[80928]:     </rng>
Nov 16 05:52:55 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:52:55 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:52:55 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:52:55 user nova-compute[80928]:     </memballoon>
Nov 16 05:52:55 user nova-compute[80928]:   </devices>
Nov 16 05:52:55 user nova-compute[80928]: </domain>
Nov 16 05:52:55 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf67a6b-fb92-4fb7-aa48-2773381e0307]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9320ab5-10c1-400d-91ba-862bf15f3ba6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:55 user nova-compute[80928]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:52:55 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:55 user nova-compute[80928]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:52:55 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585deb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e0b8f2-57d2-4cae-926a-dcbc3c177e54]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[29427932-2469-4f7b-a1f1-2bc0db1fc2e6]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba07e9d-99ac-4aef-bd51-dc8f13b03817]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61157e6-7584-40c6-9b10-ca77dfc09902]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf4245d-bb47-430c-90e9-2dcd232f965f]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a806f1-f317-4bdf-9e92-e8a83930a21b]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260]
Nov 16 05:52:55 user nova-compute[80928]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260] successful.
Nov 16 05:52:55 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1183b92d-4b04-4767-95c1-03461e61fd4c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] <== disconnect_volume: return (1617ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Start _get_guest_xml network_info=[{"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBIcNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7', 'attached_at': '', 'detached_at': '', 'volume_id': '0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2', 'serial': '0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '264f75e5-74d5-44ba-a535-42d680c09a02', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'numa_topology' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'trusted_certs' on Instance uuid aed2e3da-04aa-4ae0-976b-48c036666ec7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.objects.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.objects.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Object Instance<aed2e3da-04aa-4ae0-976b-48c036666ec7> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:52:55 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'vcpu_model' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.objects.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBIcNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:52:55 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:52:55 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:52:55 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[be25c8e5-45f9-40fb-aa15-0c0f0a7b5022]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:52:55 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48be4e8-2587-4612-a0ea-ef2c7d76513d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2] added
Nov 16 05:52:55 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3a9d49-4e6f-4632-a06b-0e64d8dcc804]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3486d4-fa38-4500-9234-0209d7581f5d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQBIcNCW {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQBIcNCW" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7196415-01cc-4efc-ad2a-968c9910c539]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yQBIcNCW'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f31d509-0a62-4a56-bee4-cce0491e4ea5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc1b4c8-6262-4c4d-ad32-897cf17ee1bb]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:52:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:52:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b0050e-776c-4a2b-9b10-0ab5cb1b3a4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260]
Nov 16 05:52:56 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260] successful.
Nov 16 05:52:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c696a330-3a9d-4a57-96d7-1dbdc3b82325]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Cannot resize image /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG nova.objects.instance [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'migration_context' on Instance uuid aed2e3da-04aa-4ae0-976b-48c036666ec7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4c2f49-d0a6-4585-bbed-be41b8f4975b]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:52:56 user nova-compute[80928]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:52:56 user nova-compute[80928]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:52:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG nova.objects.base [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Object Instance<aed2e3da-04aa-4ae0-976b-48c036666ec7> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1202134961',display_name='tempest-TestMinimumBasicScenario-server-1202134961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1202134961',id=39,image_ref='f1bbac86-d836-4690-9bee-04adeac6d7b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwr75etbHF+GYds2/A6+gBwWdRTwm8MGKYg9y2FynwipKbIjrwrc2ixUeuLeartyCa5D4y6LmpWL9kw7B+jDZtmSxI59D2d+px5fYGvvdVQLTZMKnoDIO1LFYVDsYZ1bg==',key_name='tempest-TestMinimumBasicScenario-551576560',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:50:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='eab83b1fb4d343d08be479f5c56eb843',ramdisk_id='',reservation_id='r-7ffi30vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bbac86-d836-4690-9bee-04adeac6d7b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-641847724',owner_user_name='tempest-TestMinimumBasicScenario-641847724-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:52:53Z,user_data=None,user_id='6f68adc47ff640f6ae433684f457db57',uuid=aed2e3da-04aa-4ae0-976b-48c036666ec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converting VIF {"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_vif [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70a5760d-bb54-5ffc-8e42-41a91a7b759f', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8ada52-b28c-4b05-a01a-bdd5ea51b258]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBIcNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7182f759-12, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7182f759-12, col_values=(('qos', UUID('b66334bc-61fe-4013-8868-d79442dbd81d')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7182f759-12, col_values=(('external_ids', {'iface-id': '7182f759-123a-4764-9949-767ac0f4ddb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:fe:c3', 'vm-uuid': 'aed2e3da-04aa-4ae0-976b-48c036666ec7'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:56 user nova-compute[80928]: INFO os_vif [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12')
Nov 16 05:52:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23662313763656430', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662313763656430', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1608335381',display_name='tempest-AttachVolumeTestJSON-server-1608335381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1608335381',id=38,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIheiaIxPwP6SA4L1FNfT/iVP2oIcKbZWevRs6N7x4qvsfqzxVVfO6fF8zGk5rw0ndDEv99BxFLQjD1+Tt+oqfeijNH8TrsvSWOfBX1YC4BXEZkch1QPW+6pCo5Kkt1+w==',key_name='tempest-keypair-845255928',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05d6e74da88a497ca920dcb2e07ea05a',ramdisk_id='',reservation_id='r-yk964sbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1530907565',owner_user_name='tempest-AttachVolumeTestJSON-1530907565-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be30aca2412b475498f99dddb86c5983',uuid=35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converting VIF {"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'pci_devices' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.objects.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:52:57 user nova-compute[80928]:   <uuid>35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7</uuid>
Nov 16 05:52:57 user nova-compute[80928]:   <name>instance-00000026</name>
Nov 16 05:52:57 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:52:57 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:52:57 user nova-compute[80928]:   <metadata>
Nov 16 05:52:57 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:52:57 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:52:57 user nova-compute[80928]:       <nova:name>tempest-AttachVolumeTestJSON-server-1608335381</nova:name>
Nov 16 05:52:57 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:52:55</nova:creationTime>
Nov 16 05:52:57 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:52:57 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:52:57 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:52:57 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:52:57 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:52:57 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:52:57 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:52:57 user nova-compute[80928]:       <nova:owner>
Nov 16 05:52:57 user nova-compute[80928]:         <nova:user uuid="be30aca2412b475498f99dddb86c5983">tempest-AttachVolumeTestJSON-1530907565-project-member</nova:user>
Nov 16 05:52:57 user nova-compute[80928]:         <nova:project uuid="05d6e74da88a497ca920dcb2e07ea05a">tempest-AttachVolumeTestJSON-1530907565</nova:project>
Nov 16 05:52:57 user nova-compute[80928]:       </nova:owner>
Nov 16 05:52:57 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:52:57 user nova-compute[80928]:       <nova:ports>
Nov 16 05:52:57 user nova-compute[80928]:         <nova:port uuid="7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5">
Nov 16 05:52:57 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 05:52:57 user nova-compute[80928]:         </nova:port>
Nov 16 05:52:57 user nova-compute[80928]:       </nova:ports>
Nov 16 05:52:57 user nova-compute[80928]:     </nova:instance>
Nov 16 05:52:57 user nova-compute[80928]:   </metadata>
Nov 16 05:52:57 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:52:57 user nova-compute[80928]:     <system>
Nov 16 05:52:57 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:52:57 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:52:57 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:52:57 user nova-compute[80928]:       <entry name="serial">35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7</entry>
Nov 16 05:52:57 user nova-compute[80928]:       <entry name="uuid">35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7</entry>
Nov 16 05:52:57 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:52:57 user nova-compute[80928]:     </system>
Nov 16 05:52:57 user nova-compute[80928]:   </sysinfo>
Nov 16 05:52:57 user nova-compute[80928]:   <os>
Nov 16 05:52:57 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:52:57 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:52:57 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:52:57 user nova-compute[80928]:   </os>
Nov 16 05:52:57 user nova-compute[80928]:   <features>
Nov 16 05:52:57 user nova-compute[80928]:     <acpi/>
Nov 16 05:52:57 user nova-compute[80928]:     <apic/>
Nov 16 05:52:57 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:52:57 user nova-compute[80928]:   </features>
Nov 16 05:52:57 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:52:57 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:52:57 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:52:57 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:52:57 user nova-compute[80928]:   </clock>
Nov 16 05:52:57 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:52:57 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:52:57 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:52:57 user nova-compute[80928]:   </cpu>
Nov 16 05:52:57 user nova-compute[80928]:   <devices>
Nov 16 05:52:57 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:52:57 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:52:57 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk"/>
Nov 16 05:52:57 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:52:57 user nova-compute[80928]:     </disk>
Nov 16 05:52:57 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:52:57 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:52:57 user nova-compute[80928]:       <source dev="/dev/sdb"/>
Nov 16 05:52:57 user nova-compute[80928]:       <target dev="vdb" bus="virtio"/>
Nov 16 05:52:57 user nova-compute[80928]:       <serial>0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2</serial>
Nov 16 05:52:57 user nova-compute[80928]:     </disk>
Nov 16 05:52:57 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:52:57 user nova-compute[80928]:       <mac address="fa:16:3e:86:53:a9"/>
Nov 16 05:52:57 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:52:57 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:52:57 user nova-compute[80928]:       <target dev="tap7453ccbb-c8"/>
Nov 16 05:52:57 user nova-compute[80928]:     </interface>
Nov 16 05:52:57 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:52:57 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/console.log" append="off"/>
Nov 16 05:52:57 user nova-compute[80928]:     </serial>
Nov 16 05:52:57 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:52:57 user nova-compute[80928]:     <video>
Nov 16 05:52:57 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:52:57 user nova-compute[80928]:     </video>
Nov 16 05:52:57 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:52:57 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:52:57 user nova-compute[80928]:     </rng>
Nov 16 05:52:57 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:52:57 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:52:57 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:52:57 user nova-compute[80928]:     </memballoon>
Nov 16 05:52:57 user nova-compute[80928]:   </devices>
Nov 16 05:52:57 user nova-compute[80928]: </domain>
Nov 16 05:52:57 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'trusted_certs' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.objects.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.198s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-6ad06e4d-c052-49f4-9c5f-17a28de02b6c req-85fe4103-3550-4eb1-ab0a-52d8ccaf525d service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6ad06e4d-c052-49f4-9c5f-17a28de02b6c req-85fe4103-3550-4eb1-ab0a-52d8ccaf525d service nova] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6ad06e4d-c052-49f4-9c5f-17a28de02b6c req-85fe4103-3550-4eb1-ab0a-52d8ccaf525d service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6ad06e4d-c052-49f4-9c5f-17a28de02b6c req-85fe4103-3550-4eb1-ab0a-52d8ccaf525d service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-6ad06e4d-c052-49f4-9c5f-17a28de02b6c req-85fe4103-3550-4eb1-ab0a-52d8ccaf525d service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] No waiting events found dispatching network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:52:57 user nova-compute[80928]: WARNING nova.compute.manager [req-6ad06e4d-c052-49f4-9c5f-17a28de02b6c req-85fe4103-3550-4eb1-ab0a-52d8ccaf525d service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received unexpected event network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:52:57 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Cannot resize image /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'migration_context' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG nova.objects.base [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1608335381',display_name='tempest-AttachVolumeTestJSON-server-1608335381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1608335381',id=38,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIheiaIxPwP6SA4L1FNfT/iVP2oIcKbZWevRs6N7x4qvsfqzxVVfO6fF8zGk5rw0ndDEv99BxFLQjD1+Tt+oqfeijNH8TrsvSWOfBX1YC4BXEZkch1QPW+6pCo5Kkt1+w==',key_name='tempest-keypair-845255928',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='05d6e74da88a497ca920dcb2e07ea05a',ramdisk_id='',reservation_id='r-yk964sbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1530907565',owner_user_name='tempest-AttachVolumeTestJSON-1530907565-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be30aca2412b475498f99dddb86c5983',uuid=35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converting VIF {"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG os_vif [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50d70bc0-7b04-5cff-8efb-69c0a29cf2a8', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7453ccbb-c8, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7453ccbb-c8, col_values=(('qos', UUID('df88ade9-26d6-4fa2-bba4-f2220c572404')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7453ccbb-c8, col_values=(('external_ids', {'iface-id': '7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:53:a9', 'vm-uuid': '35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:58 user nova-compute[80928]: INFO os_vif [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8')
Nov 16 05:52:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:52:59 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Instance rebooted successfully.
Nov 16 05:52:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-264ec6e3-45df-4d48-93e4-fc362f07c8f9 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.807s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-7d37703f-ca84-47e6-a910-5a210d4eb7ca req-b02eac01-eb6f-40cd-88e0-6780fefe7139 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7d37703f-ca84-47e6-a910-5a210d4eb7ca req-b02eac01-eb6f-40cd-88e0-6780fefe7139 service nova] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7d37703f-ca84-47e6-a910-5a210d4eb7ca req-b02eac01-eb6f-40cd-88e0-6780fefe7139 service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7d37703f-ca84-47e6-a910-5a210d4eb7ca req-b02eac01-eb6f-40cd-88e0-6780fefe7139 service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-7d37703f-ca84-47e6-a910-5a210d4eb7ca req-b02eac01-eb6f-40cd-88e0-6780fefe7139 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] No waiting events found dispatching network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:52:59 user nova-compute[80928]: WARNING nova.compute.manager [req-7d37703f-ca84-47e6-a910-5a210d4eb7ca req-b02eac01-eb6f-40cd-88e0-6780fefe7139 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received unexpected event network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 for instance with vm_state active and task_state None.
Nov 16 05:52:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-7d37703f-ca84-47e6-a910-5a210d4eb7ca req-b02eac01-eb6f-40cd-88e0-6780fefe7139 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7d37703f-ca84-47e6-a910-5a210d4eb7ca req-b02eac01-eb6f-40cd-88e0-6780fefe7139 service nova] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7d37703f-ca84-47e6-a910-5a210d4eb7ca req-b02eac01-eb6f-40cd-88e0-6780fefe7139 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7d37703f-ca84-47e6-a910-5a210d4eb7ca req-b02eac01-eb6f-40cd-88e0-6780fefe7139 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-7d37703f-ca84-47e6-a910-5a210d4eb7ca req-b02eac01-eb6f-40cd-88e0-6780fefe7139 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] No waiting events found dispatching network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:52:59 user nova-compute[80928]: WARNING nova.compute.manager [req-7d37703f-ca84-47e6-a910-5a210d4eb7ca req-b02eac01-eb6f-40cd-88e0-6780fefe7139 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received unexpected event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 for instance with vm_state stopped and task_state powering-on.
Nov 16 05:52:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:52:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:53:01 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance rebooted successfully.
Nov 16 05:53:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1d164d3f-58ea-48bb-9e95-852cd16df91b tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:53:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-10b5adae-f3e5-4095-9219-ea165851c2ba req-e88130d4-3e71-459b-bbbd-0ed2ed939117 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:53:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-10b5adae-f3e5-4095-9219-ea165851c2ba req-e88130d4-3e71-459b-bbbd-0ed2ed939117 service nova] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:53:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-10b5adae-f3e5-4095-9219-ea165851c2ba req-e88130d4-3e71-459b-bbbd-0ed2ed939117 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:53:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-10b5adae-f3e5-4095-9219-ea165851c2ba req-e88130d4-3e71-459b-bbbd-0ed2ed939117 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:53:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-10b5adae-f3e5-4095-9219-ea165851c2ba req-e88130d4-3e71-459b-bbbd-0ed2ed939117 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] No waiting events found dispatching network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:53:02 user nova-compute[80928]: WARNING nova.compute.manager [req-10b5adae-f3e5-4095-9219-ea165851c2ba req-e88130d4-3e71-459b-bbbd-0ed2ed939117 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received unexpected event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 for instance with vm_state active and task_state None.
Nov 16 05:53:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:53:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:53:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:53:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:11 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:53:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:13 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:53:13 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:53:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:15 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:53:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:53:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 05:53:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:18 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:53:19 user nova-compute[80928]: INFO nova.compute.manager [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Terminating instance
Nov 16 05:53:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:20 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Instance destroyed successfully.
Nov 16 05:53:20 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'resources' on Instance uuid 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-157193833',display_name='tempest-ServerRescueNegativeTestJSON-server-157193833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-157193833',id=26,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:39:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8820092d2a4d50ab092ac90e5e1d3d',ramdisk_id='',reservation_id='r-hcgyag60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-575506684',owner_user_name='tempest-ServerRescueNegativeTestJSON-575506684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:39:17Z,user_data=None,user_id='ade947942acc48ef940224970f670985',uuid=2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converting VIF {"id": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "address": "fa:16:3e:0c:6c:ee", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7139c-fa", "ovs_interfaceid": "d4f7139c-fa6d-4a1b-9353-8edcf9a38d18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6c:ee,bridge_name='br-int',has_traffic_filtering=True,id=d4f7139c-fa6d-4a1b-9353-8edcf9a38d18,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f7139c-fa') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG os_vif [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6c:ee,bridge_name='br-int',has_traffic_filtering=True,id=d4f7139c-fa6d-4a1b-9353-8edcf9a38d18,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f7139c-fa') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4f7139c-fa, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02a98fe1-1df5-4670-9dc2-d678e5583934) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:20 user nova-compute[80928]: INFO os_vif [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6c:ee,bridge_name='br-int',has_traffic_filtering=True,id=d4f7139c-fa6d-4a1b-9353-8edcf9a38d18,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f7139c-fa')
Nov 16 05:53:20 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Deleting instance files /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a_del
Nov 16 05:53:20 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Deletion of /opt/stack/data/nova/instances/2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a_del complete
Nov 16 05:53:20 user nova-compute[80928]: INFO nova.compute.manager [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 16 05:53:20 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:53:20 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid '2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid '2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a' (instance-0000001a)
Nov 16 05:53:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-37f45e62-4bfc-48d8-973c-79b2eb4c195e req-a38f536a-7c92-4468-8998-27ad0f0c2a46 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Received event network-vif-deleted-d4f7139c-fa6d-4a1b-9353-8edcf9a38d18 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:53:20 user nova-compute[80928]: INFO nova.compute.manager [req-37f45e62-4bfc-48d8-973c-79b2eb4c195e req-a38f536a-7c92-4468-8998-27ad0f0c2a46 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Neutron deleted interface d4f7139c-fa6d-4a1b-9353-8edcf9a38d18; detaching it from the instance and deleting it from the info cache
Nov 16 05:53:20 user nova-compute[80928]: DEBUG nova.network.neutron [req-37f45e62-4bfc-48d8-973c-79b2eb4c195e req-a38f536a-7c92-4468-8998-27ad0f0c2a46 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:53:20 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Took 0.49 seconds to deallocate network for instance.
Nov 16 05:53:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-37f45e62-4bfc-48d8-973c-79b2eb4c195e req-a38f536a-7c92-4468-8998-27ad0f0c2a46 service nova] [instance: 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a] Detach interface failed, port_id=d4f7139c-fa6d-4a1b-9353-8edcf9a38d18, reason: Instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:53:21 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Deleted allocations for instance 2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a
Nov 16 05:53:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f5dcd1c4-d1b2-4230-a624-b62bc89b916a tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "2ee3fb18-12f5-4af9-9dfa-a4a7e9061a0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.710s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:53:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:53:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:53:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8522MB free_disk=25.215354919433594GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:53:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4a171080-2c54-4092-902d-7a3f815656b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance aed2e3da-04aa-4ae0-976b-48c036666ec7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "742e12dd-e2ee-40be-b567-51a55636b0f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:53:22 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:53:22 user nova-compute[80928]: INFO nova.compute.claims [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Claim successful on node user
Nov 16 05:53:23 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:53:23 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:53:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:53:23 user nova-compute[80928]: DEBUG nova.compute.manager [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:53:23 user nova-compute[80928]: DEBUG nova.compute.manager [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:53:23 user nova-compute[80928]: DEBUG nova.network.neutron [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:53:23 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:53:23 user nova-compute[80928]: DEBUG nova.compute.manager [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:53:23 user nova-compute[80928]: DEBUG nova.policy [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3613cf4088874d1699e1feee5f6edc9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90f29809d44adfb12039c9b7910275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:53:23 user nova-compute[80928]: INFO nova.virt.block_device [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Booting with volume snapshot ce3a477f-b5f8-42ae-93d4-3672536e7718 at /dev/vda
Nov 16 05:53:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Successfully created port: f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:53:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Successfully updated port: f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:53:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "refresh_cache-742e12dd-e2ee-40be-b567-51a55636b0f1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:53:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquired lock "refresh_cache-742e12dd-e2ee-40be-b567-51a55636b0f1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:53:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:53:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-b461cad8-f826-4b3d-9c8c-3af44f71260e req-66c4dfdd-952d-4a51-a1d0-1fa633887c42 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Received event network-changed-f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:53:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-b461cad8-f826-4b3d-9c8c-3af44f71260e req-66c4dfdd-952d-4a51-a1d0-1fa633887c42 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Refreshing instance network info cache due to event network-changed-f999c0d2-0f3b-4953-b16e-b59de79b5b81. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:53:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b461cad8-f826-4b3d-9c8c-3af44f71260e req-66c4dfdd-952d-4a51-a1d0-1fa633887c42 service nova] Acquiring lock "refresh_cache-742e12dd-e2ee-40be-b567-51a55636b0f1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:53:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:53:25 user nova-compute[80928]: DEBUG nova.network.neutron [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Updating instance_info_cache with network_info: [{"id": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "address": "fa:16:3e:0a:cc:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf999c0d2-0f", "ovs_interfaceid": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:53:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Releasing lock "refresh_cache-742e12dd-e2ee-40be-b567-51a55636b0f1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:53:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Instance network_info: |[{"id": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "address": "fa:16:3e:0a:cc:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf999c0d2-0f", "ovs_interfaceid": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:53:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b461cad8-f826-4b3d-9c8c-3af44f71260e req-66c4dfdd-952d-4a51-a1d0-1fa633887c42 service nova] Acquired lock "refresh_cache-742e12dd-e2ee-40be-b567-51a55636b0f1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:53:25 user nova-compute[80928]: DEBUG nova.network.neutron [req-b461cad8-f826-4b3d-9c8c-3af44f71260e req-66c4dfdd-952d-4a51-a1d0-1fa633887c42 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Refreshing network info cache for port f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:53:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:25 user nova-compute[80928]: DEBUG nova.network.neutron [req-b461cad8-f826-4b3d-9c8c-3af44f71260e req-66c4dfdd-952d-4a51-a1d0-1fa633887c42 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Updated VIF entry in instance network info cache for port f999c0d2-0f3b-4953-b16e-b59de79b5b81. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:53:25 user nova-compute[80928]: DEBUG nova.network.neutron [req-b461cad8-f826-4b3d-9c8c-3af44f71260e req-66c4dfdd-952d-4a51-a1d0-1fa633887c42 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Updating instance_info_cache with network_info: [{"id": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "address": "fa:16:3e:0a:cc:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf999c0d2-0f", "ovs_interfaceid": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:53:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b461cad8-f826-4b3d-9c8c-3af44f71260e req-66c4dfdd-952d-4a51-a1d0-1fa633887c42 service nova] Releasing lock "refresh_cache-742e12dd-e2ee-40be-b567-51a55636b0f1" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:53:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:26 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:53:26 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG os_brick.utils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8f7868-18b8-4e1e-b747-ac34e274db67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95a4592-40bc-49df-a54c-53089faedf90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e701a925-98d1-40ee-ad52-e442da99bd89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccd4314-43dc-4ad2-9b19-b34905dcfdf4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:53:29 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:53:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[93086c46-2dde-4d49-a8b9-d70b049db603]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG os_brick.utils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:53:29 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Updating existing volume attachment record: 2c686740-0e7b-43bd-a1a4-ea6961852edf {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:53:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.compute.manager [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:53:34 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Creating image(s)
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Ensure instance console log exists: /opt/stack/data/nova/instances/742e12dd-e2ee-40be-b567-51a55636b0f1/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Start _get_guest_xml network_info=[{"id": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "address": "fa:16:3e:0a:cc:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf999c0d2-0f", "ovs_interfaceid": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKihsBq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '742e12dd-e2ee-40be-b567-51a55636b0f1', 'attached_at': '', 'detached_at': '', 'volume_id': '30581c47-b873-4bdb-9b0d-8dc0dcecd98d', 'serial': '30581c47-b873-4bdb-9b0d-8dc0dcecd98d'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '2c686740-0e7b-43bd-a1a4-ea6961852edf', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:53:34 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:53:34 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKihsBq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:53:34 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:53:34 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:53:34 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d316b37b-fd56-4108-a0dd-3972ff625188]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:53:34 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0038f01-f877-4ffc-929e-0cf7148f7b1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d] added
Nov 16 05:53:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f843903c-2ad5-4c2f-91d9-588f57f8bb24]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f07176-d793-460b-a00e-adeab2af5a01]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZKihsBq {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZKihsBq" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b705c0-cae7-48ce-8095-05574d2c0387]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZKihsBq'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80ca0dc-bd6f-40c5-a8ce-97cd98dee763]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b48f13f-81b7-40bc-9a3b-f5ed38399043]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:53:34 user nova-compute[80928]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:53:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:53:34 user nova-compute[80928]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:53:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b002cefa-fb95-4b87-b85f-7edccb7c41dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d, portal: 172.16.0.220,3260]
Nov 16 05:53:34 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d, portal: 172.16.0.220,3260] successful.
Nov 16 05:53:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f1431b-3410-4a92-bfed-c229ddc617bc]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[103850d4-d5d4-4358-acff-7c256cb1890d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:53:34 user nova-compute[80928]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:53:34 user nova-compute[80928]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d (non-flash)
Nov 16 05:53:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:53:34 user nova-compute[80928]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:53:34 user nova-compute[80928]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d (non-flash)
Nov 16 05:53:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61f2e25-04e0-4f5e-9545-7ef62254fd8e]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:53:34 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKihsBq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23738363436613137', 'path': '/dev/sdd'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738363436613137', 'path': '/dev/sdd'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1923912990',display_name='tempest-TestVolumeBootPattern-server-1923912990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1923912990',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-wx30w1mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:53:23Z,user_data=None,user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=742e12dd-e2ee-40be-b567-51a55636b0f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "address": "fa:16:3e:0a:cc:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf999c0d2-0f", "ovs_interfaceid": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "address": "fa:16:3e:0a:cc:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf999c0d2-0f", "ovs_interfaceid": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cc:49,bridge_name='br-int',has_traffic_filtering=True,id=f999c0d2-0f3b-4953-b16e-b59de79b5b81,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf999c0d2-0f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG nova.objects.instance [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lazy-loading 'pci_devices' on Instance uuid 742e12dd-e2ee-40be-b567-51a55636b0f1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:53:35 user nova-compute[80928]:   <uuid>742e12dd-e2ee-40be-b567-51a55636b0f1</uuid>
Nov 16 05:53:35 user nova-compute[80928]:   <name>instance-00000028</name>
Nov 16 05:53:35 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:53:35 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:53:35 user nova-compute[80928]:   <metadata>
Nov 16 05:53:35 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:53:35 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:53:35 user nova-compute[80928]:       <nova:name>tempest-TestVolumeBootPattern-server-1923912990</nova:name>
Nov 16 05:53:35 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:53:34</nova:creationTime>
Nov 16 05:53:35 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:53:35 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:53:35 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:53:35 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:53:35 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:53:35 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:53:35 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:53:35 user nova-compute[80928]:       <nova:owner>
Nov 16 05:53:35 user nova-compute[80928]:         <nova:user uuid="3613cf4088874d1699e1feee5f6edc9f">tempest-TestVolumeBootPattern-315833619-project-member</nova:user>
Nov 16 05:53:35 user nova-compute[80928]:         <nova:project uuid="4b90f29809d44adfb12039c9b7910275">tempest-TestVolumeBootPattern-315833619</nova:project>
Nov 16 05:53:35 user nova-compute[80928]:       </nova:owner>
Nov 16 05:53:35 user nova-compute[80928]:       <nova:ports>
Nov 16 05:53:35 user nova-compute[80928]:         <nova:port uuid="f999c0d2-0f3b-4953-b16e-b59de79b5b81">
Nov 16 05:53:35 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 05:53:35 user nova-compute[80928]:         </nova:port>
Nov 16 05:53:35 user nova-compute[80928]:       </nova:ports>
Nov 16 05:53:35 user nova-compute[80928]:     </nova:instance>
Nov 16 05:53:35 user nova-compute[80928]:   </metadata>
Nov 16 05:53:35 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:53:35 user nova-compute[80928]:     <system>
Nov 16 05:53:35 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:53:35 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:53:35 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:53:35 user nova-compute[80928]:       <entry name="serial">742e12dd-e2ee-40be-b567-51a55636b0f1</entry>
Nov 16 05:53:35 user nova-compute[80928]:       <entry name="uuid">742e12dd-e2ee-40be-b567-51a55636b0f1</entry>
Nov 16 05:53:35 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:53:35 user nova-compute[80928]:     </system>
Nov 16 05:53:35 user nova-compute[80928]:   </sysinfo>
Nov 16 05:53:35 user nova-compute[80928]:   <os>
Nov 16 05:53:35 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:53:35 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:53:35 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:53:35 user nova-compute[80928]:   </os>
Nov 16 05:53:35 user nova-compute[80928]:   <features>
Nov 16 05:53:35 user nova-compute[80928]:     <acpi/>
Nov 16 05:53:35 user nova-compute[80928]:     <apic/>
Nov 16 05:53:35 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:53:35 user nova-compute[80928]:   </features>
Nov 16 05:53:35 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:53:35 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:53:35 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:53:35 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:53:35 user nova-compute[80928]:   </clock>
Nov 16 05:53:35 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:53:35 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:53:35 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:53:35 user nova-compute[80928]:   </cpu>
Nov 16 05:53:35 user nova-compute[80928]:   <devices>
Nov 16 05:53:35 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:53:35 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:53:35 user nova-compute[80928]:       <source dev="/dev/sdd"/>
Nov 16 05:53:35 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:53:35 user nova-compute[80928]:       <serial>30581c47-b873-4bdb-9b0d-8dc0dcecd98d</serial>
Nov 16 05:53:35 user nova-compute[80928]:     </disk>
Nov 16 05:53:35 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:53:35 user nova-compute[80928]:       <mac address="fa:16:3e:0a:cc:49"/>
Nov 16 05:53:35 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:53:35 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:53:35 user nova-compute[80928]:       <target dev="tapf999c0d2-0f"/>
Nov 16 05:53:35 user nova-compute[80928]:     </interface>
Nov 16 05:53:35 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:53:35 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/742e12dd-e2ee-40be-b567-51a55636b0f1/console.log" append="off"/>
Nov 16 05:53:35 user nova-compute[80928]:     </serial>
Nov 16 05:53:35 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:53:35 user nova-compute[80928]:     <video>
Nov 16 05:53:35 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:53:35 user nova-compute[80928]:     </video>
Nov 16 05:53:35 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:53:35 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:53:35 user nova-compute[80928]:     </rng>
Nov 16 05:53:35 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:53:35 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:53:35 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:53:35 user nova-compute[80928]:     </memballoon>
Nov 16 05:53:35 user nova-compute[80928]:   </devices>
Nov 16 05:53:35 user nova-compute[80928]: </domain>
Nov 16 05:53:35 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1923912990',display_name='tempest-TestVolumeBootPattern-server-1923912990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1923912990',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-wx30w1mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:53:23Z,user_data=None,user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=742e12dd-e2ee-40be-b567-51a55636b0f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "address": "fa:16:3e:0a:cc:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf999c0d2-0f", "ovs_interfaceid": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "address": "fa:16:3e:0a:cc:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf999c0d2-0f", "ovs_interfaceid": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cc:49,bridge_name='br-int',has_traffic_filtering=True,id=f999c0d2-0f3b-4953-b16e-b59de79b5b81,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf999c0d2-0f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG os_vif [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cc:49,bridge_name='br-int',has_traffic_filtering=True,id=f999c0d2-0f3b-4953-b16e-b59de79b5b81,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf999c0d2-0f') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f516127f-cafa-5a80-8cdc-58cd05874c14', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf999c0d2-0f, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf999c0d2-0f, col_values=(('qos', UUID('c225b360-a66f-4c7a-89b2-1c6f0a347fd0')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf999c0d2-0f, col_values=(('external_ids', {'iface-id': 'f999c0d2-0f3b-4953-b16e-b59de79b5b81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:cc:49', 'vm-uuid': '742e12dd-e2ee-40be-b567-51a55636b0f1'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:35 user nova-compute[80928]: INFO os_vif [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cc:49,bridge_name='br-int',has_traffic_filtering=True,id=f999c0d2-0f3b-4953-b16e-b59de79b5b81,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf999c0d2-0f')
Nov 16 05:53:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:53:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] No VIF found with MAC fa:16:3e:0a:cc:49, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:53:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:37 user nova-compute[80928]: DEBUG nova.compute.manager [req-94ce4173-8bb4-4d55-9639-e73e18a55533 req-cabcda56-fcd3-431a-8956-fd0f2a64152f service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Received event network-vif-plugged-f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:53:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-94ce4173-8bb4-4d55-9639-e73e18a55533 req-cabcda56-fcd3-431a-8956-fd0f2a64152f service nova] Acquiring lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:53:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-94ce4173-8bb4-4d55-9639-e73e18a55533 req-cabcda56-fcd3-431a-8956-fd0f2a64152f service nova] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:53:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-94ce4173-8bb4-4d55-9639-e73e18a55533 req-cabcda56-fcd3-431a-8956-fd0f2a64152f service nova] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:53:37 user nova-compute[80928]: DEBUG nova.compute.manager [req-94ce4173-8bb4-4d55-9639-e73e18a55533 req-cabcda56-fcd3-431a-8956-fd0f2a64152f service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] No waiting events found dispatching network-vif-plugged-f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:53:37 user nova-compute[80928]: WARNING nova.compute.manager [req-94ce4173-8bb4-4d55-9639-e73e18a55533 req-cabcda56-fcd3-431a-8956-fd0f2a64152f service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Received unexpected event network-vif-plugged-f999c0d2-0f3b-4953-b16e-b59de79b5b81 for instance with vm_state building and task_state spawning.
Nov 16 05:53:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG nova.compute.manager [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:53:39 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Instance spawned successfully.
Nov 16 05:53:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:53:39 user nova-compute[80928]: INFO nova.compute.manager [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 16 05:53:39 user nova-compute[80928]: DEBUG nova.compute.manager [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-91ece8b3-1f71-4929-92f2-cd959d974886 req-4bda0f01-5af9-4d46-a0e4-11956ed5b7a6 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Received event network-vif-plugged-f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-91ece8b3-1f71-4929-92f2-cd959d974886 req-4bda0f01-5af9-4d46-a0e4-11956ed5b7a6 service nova] Acquiring lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-91ece8b3-1f71-4929-92f2-cd959d974886 req-4bda0f01-5af9-4d46-a0e4-11956ed5b7a6 service nova] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-91ece8b3-1f71-4929-92f2-cd959d974886 req-4bda0f01-5af9-4d46-a0e4-11956ed5b7a6 service nova] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:53:39 user nova-compute[80928]: DEBUG nova.compute.manager [req-91ece8b3-1f71-4929-92f2-cd959d974886 req-4bda0f01-5af9-4d46-a0e4-11956ed5b7a6 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] No waiting events found dispatching network-vif-plugged-f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:53:39 user nova-compute[80928]: WARNING nova.compute.manager [req-91ece8b3-1f71-4929-92f2-cd959d974886 req-4bda0f01-5af9-4d46-a0e4-11956ed5b7a6 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Received unexpected event network-vif-plugged-f999c0d2-0f3b-4953-b16e-b59de79b5b81 for instance with vm_state building and task_state spawning.
Nov 16 05:53:39 user nova-compute[80928]: INFO nova.compute.manager [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Took 16.63 seconds to build instance.
Nov 16 05:53:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-997c8ec0-3ca9-4494-a1d5-6a7612a9889d tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.802s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:53:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:53:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:54:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "4a171080-2c54-4092-902d-7a3f815656b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:54:10 user nova-compute[80928]: INFO nova.compute.manager [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Terminating instance
Nov 16 05:54:10 user nova-compute[80928]: DEBUG nova.compute.manager [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG nova.compute.manager [req-b39329fe-daaf-4022-a13b-f326722d3164 req-b50fb0ec-5ef4-4ac0-9893-06c35e46390d service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-unplugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b39329fe-daaf-4022-a13b-f326722d3164 req-b50fb0ec-5ef4-4ac0-9893-06c35e46390d service nova] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b39329fe-daaf-4022-a13b-f326722d3164 req-b50fb0ec-5ef4-4ac0-9893-06c35e46390d service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b39329fe-daaf-4022-a13b-f326722d3164 req-b50fb0ec-5ef4-4ac0-9893-06c35e46390d service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG nova.compute.manager [req-b39329fe-daaf-4022-a13b-f326722d3164 req-b50fb0ec-5ef4-4ac0-9893-06c35e46390d service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] No waiting events found dispatching network-vif-unplugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG nova.compute.manager [req-b39329fe-daaf-4022-a13b-f326722d3164 req-b50fb0ec-5ef4-4ac0-9893-06c35e46390d service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-unplugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:10 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Instance destroyed successfully.
Nov 16 05:54:10 user nova-compute[80928]: DEBUG nova.objects.instance [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lazy-loading 'resources' on Instance uuid 4a171080-2c54-4092-902d-7a3f815656b9 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-778331140',display_name='tempest-ServerRescueNegativeTestJSON-server-778331140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-778331140',id=25,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8820092d2a4d50ab092ac90e5e1d3d',ramdisk_id='',reservation_id='r-uqenc8b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-575506684',owner_user_name='tempest-ServerRescueNegativeTestJSON-575506684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:44:00Z,user_data=None,user_id='ade947942acc48ef940224970f670985',uuid=4a171080-2c54-4092-902d-7a3f815656b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converting VIF {"id": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "address": "fa:16:3e:a4:c7:d5", "network": {"id": "83a86a51-bd54-4f4d-a45f-497d552ec79d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1203368512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8820092d2a4d50ab092ac90e5e1d3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0876efd5-37", "ovs_interfaceid": "0876efd5-37cf-44b7-b6da-1c02bc4f33b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:c7:d5,bridge_name='br-int',has_traffic_filtering=True,id=0876efd5-37cf-44b7-b6da-1c02bc4f33b0,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0876efd5-37') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG os_vif [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:c7:d5,bridge_name='br-int',has_traffic_filtering=True,id=0876efd5-37cf-44b7-b6da-1c02bc4f33b0,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0876efd5-37') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0876efd5-37, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a5a448a-4cee-48d8-9b7b-adb0d523e53e) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:54:10 user nova-compute[80928]: INFO os_vif [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:c7:d5,bridge_name='br-int',has_traffic_filtering=True,id=0876efd5-37cf-44b7-b6da-1c02bc4f33b0,network=Network(83a86a51-bd54-4f4d-a45f-497d552ec79d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0876efd5-37')
Nov 16 05:54:10 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Deleting instance files /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9_del
Nov 16 05:54:10 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Deletion of /opt/stack/data/nova/instances/4a171080-2c54-4092-902d-7a3f815656b9_del complete
Nov 16 05:54:10 user nova-compute[80928]: INFO nova.compute.manager [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 16 05:54:10 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:54:10 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:54:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:11 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:54:11 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Took 0.47 seconds to deallocate network for instance.
Nov 16 05:54:11 user nova-compute[80928]: DEBUG nova.compute.manager [req-c7ee1540-eb0a-4420-b3f6-f372cc8de3b7 req-07c5c5de-52ab-43d1-885a-822c98fead12 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-deleted-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:54:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:54:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:54:11 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:54:11 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:54:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:54:11 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Deleted allocations for instance 4a171080-2c54-4092-902d-7a3f815656b9
Nov 16 05:54:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-05610ceb-91e1-4f31-b525-f7597d12ea0b tempest-ServerRescueNegativeTestJSON-575506684 tempest-ServerRescueNegativeTestJSON-575506684-project-member] Lock "4a171080-2c54-4092-902d-7a3f815656b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.548s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:54:12 user nova-compute[80928]: DEBUG nova.compute.manager [req-b6f31418-acd1-415f-a741-20e793661a8f req-7c93b1f9-d8e5-4e32-8ab2-52c5d1a73e40 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:54:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6f31418-acd1-415f-a741-20e793661a8f req-7c93b1f9-d8e5-4e32-8ab2-52c5d1a73e40 service nova] Acquiring lock "4a171080-2c54-4092-902d-7a3f815656b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:54:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6f31418-acd1-415f-a741-20e793661a8f req-7c93b1f9-d8e5-4e32-8ab2-52c5d1a73e40 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:54:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b6f31418-acd1-415f-a741-20e793661a8f req-7c93b1f9-d8e5-4e32-8ab2-52c5d1a73e40 service nova] Lock "4a171080-2c54-4092-902d-7a3f815656b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:54:12 user nova-compute[80928]: DEBUG nova.compute.manager [req-b6f31418-acd1-415f-a741-20e793661a8f req-7c93b1f9-d8e5-4e32-8ab2-52c5d1a73e40 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] No waiting events found dispatching network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:54:12 user nova-compute[80928]: WARNING nova.compute.manager [req-b6f31418-acd1-415f-a741-20e793661a8f req-7c93b1f9-d8e5-4e32-8ab2-52c5d1a73e40 service nova] [instance: 4a171080-2c54-4092-902d-7a3f815656b9] Received unexpected event network-vif-plugged-0876efd5-37cf-44b7-b6da-1c02bc4f33b0 for instance with vm_state deleted and task_state None.
Nov 16 05:54:13 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:54:13 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:54:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:54:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:17 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:54:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:54:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 05:54:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:54:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:54:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:54:17 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:54:18 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updating instance_info_cache with network_info: [{"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:54:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:54:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:54:18 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:54:19 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:54:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:54:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:54:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:54:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:54:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:54:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:54:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:54:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:54:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:54:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:54:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:54:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:54:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:54:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:54:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:54:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:54:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:54:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8611MB free_disk=25.269432067871094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:54:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:54:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:54:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:54:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance aed2e3da-04aa-4ae0-976b-48c036666ec7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:54:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 742e12dd-e2ee-40be-b567-51a55636b0f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:54:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:54:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:54:21 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:54:21 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:54:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:54:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:54:25 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:54:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:54:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:54:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:54:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:54:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:54:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:54:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:54:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:54:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:54:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:54:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:54:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:54:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:54:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-e1584aac-b5b1-4198-a339-8c8d3cb59f5d req-da589f95-9fcc-4406-84fd-448649fa4c46 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-changed-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-e1584aac-b5b1-4198-a339-8c8d3cb59f5d req-da589f95-9fcc-4406-84fd-448649fa4c46 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Refreshing instance network info cache due to event network-changed-7182f759-123a-4764-9949-767ac0f4ddb6. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e1584aac-b5b1-4198-a339-8c8d3cb59f5d req-da589f95-9fcc-4406-84fd-448649fa4c46 service nova] Acquiring lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e1584aac-b5b1-4198-a339-8c8d3cb59f5d req-da589f95-9fcc-4406-84fd-448649fa4c46 service nova] Acquired lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG nova.network.neutron [req-e1584aac-b5b1-4198-a339-8c8d3cb59f5d req-da589f95-9fcc-4406-84fd-448649fa4c46 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Refreshing network info cache for port 7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:54:44 user nova-compute[80928]: INFO nova.compute.manager [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Detaching volume 0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2
Nov 16 05:54:44 user nova-compute[80928]: DEBUG nova.network.neutron [req-e1584aac-b5b1-4198-a339-8c8d3cb59f5d req-da589f95-9fcc-4406-84fd-448649fa4c46 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updated VIF entry in instance network info cache for port 7182f759-123a-4764-9949-767ac0f4ddb6. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG nova.network.neutron [req-e1584aac-b5b1-4198-a339-8c8d3cb59f5d req-da589f95-9fcc-4406-84fd-448649fa4c46 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updating instance_info_cache with network_info: [{"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:54:44 user nova-compute[80928]: INFO nova.virt.block_device [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Attempting to driver detach volume 0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 from mountpoint /dev/vdb
Nov 16 05:54:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e1584aac-b5b1-4198-a339-8c8d3cb59f5d req-da589f95-9fcc-4406-84fd-448649fa4c46 service nova] Releasing lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Attempting to detach device vdb from instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:54:44 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:54:44 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 05:54:44 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:54:44 user nova-compute[80928]:   <serial>0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2</serial>
Nov 16 05:54:44 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 05:54:44 user nova-compute[80928]: </disk>
Nov 16 05:54:44 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:54:44 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully detached device vdb from instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 from the persistent domain config.
Nov 16 05:54:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:54:44 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:54:44 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 05:54:44 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:54:44 user nova-compute[80928]:   <serial>0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2</serial>
Nov 16 05:54:44 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 05:54:44 user nova-compute[80928]: </disk>
Nov 16 05:54:44 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-5b044ab6-e085-4854-abf8-182266744f5d req-cbddf0a8-000f-4af2-b4aa-003aaa232799 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-changed-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-5b044ab6-e085-4854-abf8-182266744f5d req-cbddf0a8-000f-4af2-b4aa-003aaa232799 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Refreshing instance network info cache due to event network-changed-7182f759-123a-4764-9949-767ac0f4ddb6. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5b044ab6-e085-4854-abf8-182266744f5d req-cbddf0a8-000f-4af2-b4aa-003aaa232799 service nova] Acquiring lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5b044ab6-e085-4854-abf8-182266744f5d req-cbddf0a8-000f-4af2-b4aa-003aaa232799 service nova] Acquired lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:54:44 user nova-compute[80928]: DEBUG nova.network.neutron [req-5b044ab6-e085-4854-abf8-182266744f5d req-cbddf0a8-000f-4af2-b4aa-003aaa232799 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Refreshing network info cache for port 7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:54:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:54:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:54:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:54:45 user nova-compute[80928]: INFO nova.compute.manager [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Detaching volume 317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f
Nov 16 05:54:45 user nova-compute[80928]: INFO nova.virt.block_device [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Attempting to driver detach volume 317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f from mountpoint /dev/vdb
Nov 16 05:54:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Attempting to detach device vdb from instance aed2e3da-04aa-4ae0-976b-48c036666ec7 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 05:54:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:54:45 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:54:45 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 05:54:45 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:54:45 user nova-compute[80928]:   <serial>317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f</serial>
Nov 16 05:54:45 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 05:54:45 user nova-compute[80928]: </disk>
Nov 16 05:54:45 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:54:45 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Successfully detached device vdb from instance aed2e3da-04aa-4ae0-976b-48c036666ec7 from the persistent domain config.
Nov 16 05:54:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aed2e3da-04aa-4ae0-976b-48c036666ec7 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 05:54:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 05:54:45 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:54:45 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 05:54:45 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:54:45 user nova-compute[80928]:   <serial>317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f</serial>
Nov 16 05:54:45 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 05:54:45 user nova-compute[80928]: </disk>
Nov 16 05:54:45 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 05:54:45 user nova-compute[80928]: DEBUG nova.network.neutron [req-5b044ab6-e085-4854-abf8-182266744f5d req-cbddf0a8-000f-4af2-b4aa-003aaa232799 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updated VIF entry in instance network info cache for port 7182f759-123a-4764-9949-767ac0f4ddb6. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:54:45 user nova-compute[80928]: DEBUG nova.network.neutron [req-5b044ab6-e085-4854-abf8-182266744f5d req-cbddf0a8-000f-4af2-b4aa-003aaa232799 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updating instance_info_cache with network_info: [{"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:54:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5b044ab6-e085-4854-abf8-182266744f5d req-cbddf0a8-000f-4af2-b4aa-003aaa232799 service nova] Releasing lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:54:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aed2e3da-04aa-4ae0-976b-48c036666ec7 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 05:54:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:54:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:05 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 is timed out.
Nov 16 05:55:05 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully detached device vdb from instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 from the live domain config.
Nov 16 05:55:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBIcNCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:55:05 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32829eb-8b1d-4353-aea6-8f4c6c10f113]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:55:05 user nova-compute[80928]: No targets found.
Nov 16 05:55:05 user nova-compute[80928]: iSNS:
Nov 16 05:55:05 user nova-compute[80928]: No targets found.
Nov 16 05:55:05 user nova-compute[80928]: STATIC:
Nov 16 05:55:05 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2
Nov 16 05:55:05 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:55:05 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:55:05 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f
Nov 16 05:55:05 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:55:05 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:55:05 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d
Nov 16 05:55:05 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:55:05 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:55:05 user nova-compute[80928]: FIRMWARE:
Nov 16 05:55:05 user nova-compute[80928]: No targets found.
Nov 16 05:55:05 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:55:05 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:55:05 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[00901630-a7f8-411f-8e33-8a6f38979f69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[425d0cee-ed4c-4e4a-92f7-7ba22e51c51e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:55:05 user nova-compute[80928]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:55:05 user nova-compute[80928]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d (non-flash)
Nov 16 05:55:05 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:55:05 user nova-compute[80928]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 (non-flash)
Nov 16 05:55:05 user nova-compute[80928]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d (non-flash)
Nov 16 05:55:05 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86583ff880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[733290e1-ec30-490c-9d2b-89d88f029abf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3357c74-f118-47e9-8767-c5d65eb1c0cd]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[642d041d-2dc8-4709-a496-bd3c1fb5872c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9c598a-4b74-410a-a7f7-08ab55fe8b27]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5020da4-2820-44e7-b985-61920919537d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[798b0cc3-8459-4daf-be73-0b7a875dc1bc]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260]
Nov 16 05:55:05 user nova-compute[80928]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2, portal: 172.16.0.220,3260] successful.
Nov 16 05:55:05 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9f22ea-6ee2-4b2e-9548-8ea6a2116bd2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a808b5-52f6-4279-a9e2-35517e1f4ac8]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] <== disconnect_volume: return (295ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:55:05 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aed2e3da-04aa-4ae0-976b-48c036666ec7 is timed out.
Nov 16 05:55:05 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Successfully detached device vdb from instance aed2e3da-04aa-4ae0-976b-48c036666ec7 from the live domain config.
Nov 16 05:55:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaAmRhiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:55:05 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb76987-2daf-4c7c-a0a3-c8e8066ca8a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:55:05 user nova-compute[80928]: No targets found.
Nov 16 05:55:05 user nova-compute[80928]: iSNS:
Nov 16 05:55:05 user nova-compute[80928]: No targets found.
Nov 16 05:55:05 user nova-compute[80928]: STATIC:
Nov 16 05:55:05 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f
Nov 16 05:55:05 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:55:05 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:55:05 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d
Nov 16 05:55:05 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:55:05 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:55:05 user nova-compute[80928]: FIRMWARE:
Nov 16 05:55:05 user nova-compute[80928]: No targets found.
Nov 16 05:55:05 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:55:05 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:55:05 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[11032364-9903-4756-8c4c-3aa93c86f190]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a222a3-98c2-45ac-834d-febb6b474011]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:55:05 user nova-compute[80928]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d (non-flash)
Nov 16 05:55:05 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f (non-flash)
Nov 16 05:55:05 user nova-compute[80928]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d (non-flash)
Nov 16 05:55:05 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86583efd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbae4a2-1e6e-4bc2-868e-b81e539ed394]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[589ddedc-11a6-4037-87ae-3002c8827853]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a8dd8-7f72-4a0a-bc3b-b3387fd27658]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b899cc-e6ac-4fd0-8486-0fa823a232b6]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:55:05 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dac4dcd-57a8-4bff-b6d9-0cb656d62189]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c188f4f7-e69e-493f-bcf5-9e597bb27b57]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260]
Nov 16 05:55:06 user nova-compute[80928]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f, portal: 172.16.0.220,3260] successful.
Nov 16 05:55:06 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317c5da3-8e4e-4ed7-a1b2-9e6d3d146b3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e444c7-f961-44d5-94b5-0cac27865fe1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] <== disconnect_volume: return (310ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG nova.objects.instance [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-ab2efcc4-cc4b-4ef4-bb9b-86bf47fddcd8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.761s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG nova.objects.instance [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'flavor' on Instance uuid aed2e3da-04aa-4ae0-976b-48c036666ec7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:55:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-86512a42-e6f4-4ee6-82e6-93cb01c1534a tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.653s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c4bbabca-00b2-43ba-bed2-c5a212f9df80 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c4bbabca-00b2-43ba-bed2-c5a212f9df80 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c4bbabca-00b2-43ba-bed2-c5a212f9df80 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c4bbabca-00b2-43ba-bed2-c5a212f9df80 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=80928) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c4bbabca-00b2-43ba-bed2-c5a212f9df80 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-6b9e2f30-65f1-4d53-be7a-5adfc0cf3623 req-0de66bf5-ba05-4492-9653-994f1cac25f6 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-unplugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6b9e2f30-65f1-4d53-be7a-5adfc0cf3623 req-0de66bf5-ba05-4492-9653-994f1cac25f6 service nova] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6b9e2f30-65f1-4d53-be7a-5adfc0cf3623 req-0de66bf5-ba05-4492-9653-994f1cac25f6 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6b9e2f30-65f1-4d53-be7a-5adfc0cf3623 req-0de66bf5-ba05-4492-9653-994f1cac25f6 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-6b9e2f30-65f1-4d53-be7a-5adfc0cf3623 req-0de66bf5-ba05-4492-9653-994f1cac25f6 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] No waiting events found dispatching network-vif-unplugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:55:07 user nova-compute[80928]: WARNING nova.compute.manager [req-6b9e2f30-65f1-4d53-be7a-5adfc0cf3623 req-0de66bf5-ba05-4492-9653-994f1cac25f6 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received unexpected event network-vif-unplugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 for instance with vm_state active and task_state powering-off.
Nov 16 05:55:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance destroyed successfully.
Nov 16 05:55:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-c4bbabca-00b2-43ba-bed2-c5a212f9df80 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:55:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c4bbabca-00b2-43ba-bed2-c5a212f9df80 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.843s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-dfe1f7bc-8202-4a86-b4b6-b9dcaa8eca13 req-17fabb0a-2418-45f4-92a2-26372d705d5b service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:55:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dfe1f7bc-8202-4a86-b4b6-b9dcaa8eca13 req-17fabb0a-2418-45f4-92a2-26372d705d5b service nova] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dfe1f7bc-8202-4a86-b4b6-b9dcaa8eca13 req-17fabb0a-2418-45f4-92a2-26372d705d5b service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-dfe1f7bc-8202-4a86-b4b6-b9dcaa8eca13 req-17fabb0a-2418-45f4-92a2-26372d705d5b service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-dfe1f7bc-8202-4a86-b4b6-b9dcaa8eca13 req-17fabb0a-2418-45f4-92a2-26372d705d5b service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] No waiting events found dispatching network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:55:09 user nova-compute[80928]: WARNING nova.compute.manager [req-dfe1f7bc-8202-4a86-b4b6-b9dcaa8eca13 req-17fabb0a-2418-45f4-92a2-26372d705d5b service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received unexpected event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 for instance with vm_state stopped and task_state None.
Nov 16 05:55:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:10 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances with incomplete migration  {{(pid=80928) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 05:55:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:11 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "742e12dd-e2ee-40be-b567-51a55636b0f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:13 user nova-compute[80928]: INFO nova.compute.manager [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Terminating instance
Nov 16 05:55:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-7e8b7b92-1c90-41e0-84ff-82e182186a6e req-0130dac3-40c1-40f7-9d07-8d46bf301898 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Received event network-vif-unplugged-f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7e8b7b92-1c90-41e0-84ff-82e182186a6e req-0130dac3-40c1-40f7-9d07-8d46bf301898 service nova] Acquiring lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7e8b7b92-1c90-41e0-84ff-82e182186a6e req-0130dac3-40c1-40f7-9d07-8d46bf301898 service nova] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7e8b7b92-1c90-41e0-84ff-82e182186a6e req-0130dac3-40c1-40f7-9d07-8d46bf301898 service nova] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-7e8b7b92-1c90-41e0-84ff-82e182186a6e req-0130dac3-40c1-40f7-9d07-8d46bf301898 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] No waiting events found dispatching network-vif-unplugged-f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-7e8b7b92-1c90-41e0-84ff-82e182186a6e req-0130dac3-40c1-40f7-9d07-8d46bf301898 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Received event network-vif-unplugged-f999c0d2-0f3b-4953-b16e-b59de79b5b81 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:13 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:13 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Instance destroyed successfully.
Nov 16 05:55:14 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lazy-loading 'resources' on Instance uuid 742e12dd-e2ee-40be-b567-51a55636b0f1 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1923912990',display_name='tempest-TestVolumeBootPattern-server-1923912990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1923912990',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:53:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-wx30w1mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:53:39Z,user_data=None,user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=742e12dd-e2ee-40be-b567-51a55636b0f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "address": "fa:16:3e:0a:cc:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf999c0d2-0f", "ovs_interfaceid": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "address": "fa:16:3e:0a:cc:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf999c0d2-0f", "ovs_interfaceid": "f999c0d2-0f3b-4953-b16e-b59de79b5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cc:49,bridge_name='br-int',has_traffic_filtering=True,id=f999c0d2-0f3b-4953-b16e-b59de79b5b81,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf999c0d2-0f') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_vif [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cc:49,bridge_name='br-int',has_traffic_filtering=True,id=f999c0d2-0f3b-4953-b16e-b59de79b5b81,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf999c0d2-0f') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf999c0d2-0f, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c225b360-a66f-4c7a-89b2-1c6f0a347fd0) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:14 user nova-compute[80928]: INFO os_vif [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cc:49,bridge_name='br-int',has_traffic_filtering=True,id=f999c0d2-0f3b-4953-b16e-b59de79b5b81,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf999c0d2-0f')
Nov 16 05:55:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZKihsBq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:55:14 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a8b29f-8c64-42a9-9ca9-7e7bc5504b01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 05:55:14 user nova-compute[80928]: No targets found.
Nov 16 05:55:14 user nova-compute[80928]: iSNS:
Nov 16 05:55:14 user nova-compute[80928]: No targets found.
Nov 16 05:55:14 user nova-compute[80928]: STATIC:
Nov 16 05:55:14 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d
Nov 16 05:55:14 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 05:55:14 user nova-compute[80928]:                 Iface Name: default
Nov 16 05:55:14 user nova-compute[80928]: FIRMWARE:
Nov 16 05:55:14 user nova-compute[80928]: No targets found.
Nov 16 05:55:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 05:55:14 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 05:55:14 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b1eb64-3622-4c54-bc43-08813f3cd716]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e26130e-a869-4a25-ac44-7c08a1731f48]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d (non-flash)
Nov 16 05:55:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d (non-flash)
Nov 16 05:55:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8678204ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d'): ({'sdd'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Removing single pathed devices sdd {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb63bd1b-9b8e-44e2-827e-5a2af8e53887]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de6e34c-adf4-447a-940f-e5b0a7448f82]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flushing IO for device /dev/sdd {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[231ccea4-5136-49b7-99f0-ec407d6f8943]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c0204d-496e-499a-9fe4-a5eefc526ca3]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d60ba70f',) {{(pid=92262) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba619316-deff-4836-8b59-5efe82e3cdde]: (4, None) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[492fef02-db06-4d38-a095-5265d00314eb]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9b2e9f-55cf-44e3-b0ce-c937978cb52b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d, portal: 172.16.0.220,3260]
Nov 16 05:55:14 user nova-compute[80928]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d, portal: 172.16.0.220,3260] successful.
Nov 16 05:55:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30581c47-b873-4bdb-9b0d-8dc0dcecd98d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a10dff3-eda3-4609-80ed-558fb65d88ce]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== disconnect_volume: return (290ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 05:55:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Deleting instance files /opt/stack/data/nova/instances/742e12dd-e2ee-40be-b567-51a55636b0f1_del
Nov 16 05:55:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Deletion of /opt/stack/data/nova/instances/742e12dd-e2ee-40be-b567-51a55636b0f1_del complete
Nov 16 05:55:14 user nova-compute[80928]: INFO nova.compute.manager [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:14 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:55:14 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Took 0.49 seconds to deallocate network for instance.
Nov 16 05:55:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-ba77914f-b6e8-412c-901f-e169aaa3b7d3 req-044dd922-86f6-4d6e-8fa4-a2c754386fd2 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Received event network-vif-plugged-f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:55:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ba77914f-b6e8-412c-901f-e169aaa3b7d3 req-044dd922-86f6-4d6e-8fa4-a2c754386fd2 service nova] Acquiring lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ba77914f-b6e8-412c-901f-e169aaa3b7d3 req-044dd922-86f6-4d6e-8fa4-a2c754386fd2 service nova] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ba77914f-b6e8-412c-901f-e169aaa3b7d3 req-044dd922-86f6-4d6e-8fa4-a2c754386fd2 service nova] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-ba77914f-b6e8-412c-901f-e169aaa3b7d3 req-044dd922-86f6-4d6e-8fa4-a2c754386fd2 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] No waiting events found dispatching network-vif-plugged-f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:55:15 user nova-compute[80928]: WARNING nova.compute.manager [req-ba77914f-b6e8-412c-901f-e169aaa3b7d3 req-044dd922-86f6-4d6e-8fa4-a2c754386fd2 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Received unexpected event network-vif-plugged-f999c0d2-0f3b-4953-b16e-b59de79b5b81 for instance with vm_state active and task_state deleting.
Nov 16 05:55:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-ba77914f-b6e8-412c-901f-e169aaa3b7d3 req-044dd922-86f6-4d6e-8fa4-a2c754386fd2 service nova] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Received event network-vif-deleted-f999c0d2-0f3b-4953-b16e-b59de79b5b81 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:55:15 user nova-compute[80928]: INFO nova.compute.manager [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Took 0.86 seconds to detach 1 volumes for instance.
Nov 16 05:55:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 742e12dd-e2ee-40be-b567-51a55636b0f1] Deleting volume: 30581c47-b873-4bdb-9b0d-8dc0dcecd98d {{(pid=80928) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 05:55:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:16 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:55:16 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:55:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:16 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Deleted allocations for instance 742e12dd-e2ee-40be-b567-51a55636b0f1
Nov 16 05:55:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f03c6858-3d12-4f8e-a029-db153c05babd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "742e12dd-e2ee-40be-b567-51a55636b0f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.977s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:16 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:18 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:55:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:55:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:55:18 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:55:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:19 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updating instance_info_cache with network_info: [{"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:55:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-aed2e3da-04aa-4ae0-976b-48c036666ec7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:55:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:55:19 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:19 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:19 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:55:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:55:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:55:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:55:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=25.267349243164062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance aed2e3da-04aa-4ae0-976b-48c036666ec7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing inventories for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating ProviderTree inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing aggregate associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, aggregates: None {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing trait associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:55:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:26 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:26 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:55:28 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:55:33 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:33 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 05:55:33 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] There are 0 instances to clean {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 05:55:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:55:36 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:55:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:37 user nova-compute[80928]: INFO nova.compute.manager [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Terminating instance
Nov 16 05:55:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:55:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-8fba7e5e-fb08-4b98-8f0c-b6b7ce973bf6 req-50177ad4-f2bf-4b73-80f0-92a0b23589b8 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-vif-unplugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8fba7e5e-fb08-4b98-8f0c-b6b7ce973bf6 req-50177ad4-f2bf-4b73-80f0-92a0b23589b8 service nova] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8fba7e5e-fb08-4b98-8f0c-b6b7ce973bf6 req-50177ad4-f2bf-4b73-80f0-92a0b23589b8 service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8fba7e5e-fb08-4b98-8f0c-b6b7ce973bf6 req-50177ad4-f2bf-4b73-80f0-92a0b23589b8 service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-8fba7e5e-fb08-4b98-8f0c-b6b7ce973bf6 req-50177ad4-f2bf-4b73-80f0-92a0b23589b8 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] No waiting events found dispatching network-vif-unplugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-8fba7e5e-fb08-4b98-8f0c-b6b7ce973bf6 req-50177ad4-f2bf-4b73-80f0-92a0b23589b8 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-vif-unplugged-7182f759-123a-4764-9949-767ac0f4ddb6 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:55:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Instance destroyed successfully.
Nov 16 05:55:38 user nova-compute[80928]: DEBUG nova.objects.instance [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'resources' on Instance uuid aed2e3da-04aa-4ae0-976b-48c036666ec7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1202134961',display_name='tempest-TestMinimumBasicScenario-server-1202134961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1202134961',id=39,image_ref='f1bbac86-d836-4690-9bee-04adeac6d7b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwr75etbHF+GYds2/A6+gBwWdRTwm8MGKYg9y2FynwipKbIjrwrc2ixUeuLeartyCa5D4y6LmpWL9kw7B+jDZtmSxI59D2d+px5fYGvvdVQLTZMKnoDIO1LFYVDsYZ1bg==',key_name='tempest-TestMinimumBasicScenario-551576560',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:50:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eab83b1fb4d343d08be479f5c56eb843',ramdisk_id='',reservation_id='r-7ffi30vt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1bbac86-d836-4690-9bee-04adeac6d7b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-641847724',owner_user_name='tempest-TestMinimumBasicScenario-641847724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:53:00Z,user_data=None,user_id='6f68adc47ff640f6ae433684f457db57',uuid=aed2e3da-04aa-4ae0-976b-48c036666ec7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converting VIF {"id": "7182f759-123a-4764-9949-767ac0f4ddb6", "address": "fa:16:3e:41:fe:c3", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7182f759-12", "ovs_interfaceid": "7182f759-123a-4764-9949-767ac0f4ddb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG os_vif [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7182f759-12, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b66334bc-61fe-4013-8868-d79442dbd81d) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:38 user nova-compute[80928]: INFO os_vif [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:c3,bridge_name='br-int',has_traffic_filtering=True,id=7182f759-123a-4764-9949-767ac0f4ddb6,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7182f759-12')
Nov 16 05:55:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Deleting instance files /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7_del
Nov 16 05:55:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Deletion of /opt/stack/data/nova/instances/aed2e3da-04aa-4ae0-976b-48c036666ec7_del complete
Nov 16 05:55:38 user nova-compute[80928]: INFO nova.compute.manager [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 05:55:38 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:55:38 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:55:39 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:55:39 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Took 0.56 seconds to deallocate network for instance.
Nov 16 05:55:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:39 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:55:39 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:55:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:39 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Deleted allocations for instance aed2e3da-04aa-4ae0-976b-48c036666ec7
Nov 16 05:55:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-bd04e873-a38e-4966-b1ce-66b62978f45e tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.898s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-7dc1555f-2b2d-4abd-b492-9039466df42c req-61f14a55-e651-493e-8934-0089b33fdc45 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:55:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7dc1555f-2b2d-4abd-b492-9039466df42c req-61f14a55-e651-493e-8934-0089b33fdc45 service nova] Acquiring lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:55:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7dc1555f-2b2d-4abd-b492-9039466df42c req-61f14a55-e651-493e-8934-0089b33fdc45 service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:55:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7dc1555f-2b2d-4abd-b492-9039466df42c req-61f14a55-e651-493e-8934-0089b33fdc45 service nova] Lock "aed2e3da-04aa-4ae0-976b-48c036666ec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:55:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-7dc1555f-2b2d-4abd-b492-9039466df42c req-61f14a55-e651-493e-8934-0089b33fdc45 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] No waiting events found dispatching network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:55:40 user nova-compute[80928]: WARNING nova.compute.manager [req-7dc1555f-2b2d-4abd-b492-9039466df42c req-61f14a55-e651-493e-8934-0089b33fdc45 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received unexpected event network-vif-plugged-7182f759-123a-4764-9949-767ac0f4ddb6 for instance with vm_state deleted and task_state None.
Nov 16 05:55:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-7dc1555f-2b2d-4abd-b492-9039466df42c req-61f14a55-e651-493e-8934-0089b33fdc45 service nova] [instance: aed2e3da-04aa-4ae0-976b-48c036666ec7] Received event network-vif-deleted-7182f759-123a-4764-9949-767ac0f4ddb6 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:55:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:55:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:55:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:55:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:55:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:55:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:55:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:55:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:55:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:56:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:56:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:56:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:56:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:03 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_power_states {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:56:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 05:56:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:56:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:56:12 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:56:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:56:13 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:56:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:14 user nova-compute[80928]: DEBUG nova.compute.manager [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:56:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:14 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:56:14 user nova-compute[80928]: INFO nova.compute.claims [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Claim successful on node user
Nov 16 05:56:14 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:56:14 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:56:14 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:14 user nova-compute[80928]: DEBUG nova.compute.manager [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG nova.network.neutron [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:56:15 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:56:15 user nova-compute[80928]: DEBUG nova.compute.manager [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:56:15 user nova-compute[80928]: INFO nova.virt.block_device [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Booting with volume f4412938-4663-4c36-8272-69a1814e6814 at /dev/vda
Nov 16 05:56:15 user nova-compute[80928]: DEBUG nova.policy [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3613cf4088874d1699e1feee5f6edc9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90f29809d44adfb12039c9b7910275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG os_brick.utils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2fe27d-6439-4b60-a218-8c6ea321ff59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6122b15-a8c6-4fdc-a021-fff9b186a293]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d4b92f-4583-4631-b36d-0c3e340628d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8876fb-fc0d-4766-a91c-36086b313305]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:56:15 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[69256861-fcd4-4033-9bde-27d4a24cc41d]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG os_brick.utils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Updating existing volume attachment record: 978eac3e-0ec5-45cf-a8bc-98495582fcf3 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:56:15 user nova-compute[80928]: DEBUG nova.network.neutron [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Successfully created port: 18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Successfully updated port: 18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquired lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-9f0a969c-ab39-41ca-ae25-fff882450d17 req-8840770d-682c-4252-aaba-e52bc701a9b3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-changed-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG nova.compute.manager [req-9f0a969c-ab39-41ca-ae25-fff882450d17 req-8840770d-682c-4252-aaba-e52bc701a9b3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Refreshing instance network info cache due to event network-changed-18ac81db-3540-4b1f-b16e-3fbbaf2671cb. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9f0a969c-ab39-41ca-ae25-fff882450d17 req-8840770d-682c-4252-aaba-e52bc701a9b3 service nova] Acquiring lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Updating instance_info_cache with network_info: [{"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Releasing lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Instance network_info: |[{"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9f0a969c-ab39-41ca-ae25-fff882450d17 req-8840770d-682c-4252-aaba-e52bc701a9b3 service nova] Acquired lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG nova.network.neutron [req-9f0a969c-ab39-41ca-ae25-fff882450d17 req-8840770d-682c-4252-aaba-e52bc701a9b3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Refreshing network info cache for port 18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:56:16 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:56:17 user nova-compute[80928]: DEBUG nova.network.neutron [req-9f0a969c-ab39-41ca-ae25-fff882450d17 req-8840770d-682c-4252-aaba-e52bc701a9b3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Updated VIF entry in instance network info cache for port 18ac81db-3540-4b1f-b16e-3fbbaf2671cb. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:56:17 user nova-compute[80928]: DEBUG nova.network.neutron [req-9f0a969c-ab39-41ca-ae25-fff882450d17 req-8840770d-682c-4252-aaba-e52bc701a9b3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Updating instance_info_cache with network_info: [{"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:56:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9f0a969c-ab39-41ca-ae25-fff882450d17 req-8840770d-682c-4252-aaba-e52bc701a9b3 service nova] Releasing lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:56:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:19 user nova-compute[80928]: DEBUG nova.compute.manager [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:56:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:56:19 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Creating image(s)
Nov 16 05:56:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:56:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Ensure instance console log exists: /opt/stack/data/nova/instances/5dc200e9-4a4e-47cd-be4a-905c2f34186e/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:56:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Start _get_guest_xml network_info=[{"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYARhmkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5dc200e9-4a4e-47cd-be4a-905c2f34186e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4412938-4663-4c36-8272-69a1814e6814', 'serial': 'f4412938-4663-4c36-8272-69a1814e6814'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '978eac3e-0ec5-45cf-a8bc-98495582fcf3', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:56:20 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:56:20 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYARhmkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:56:20 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:56:20 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:56:20 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe7d81-c1f5-4fe6-acd2-db1f0bc17d64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:56:20 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d1049a-7868-44f0-a5e8-0f62347c937b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814] added
Nov 16 05:56:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d1bfcc-d028-4651-b59b-1e0288d8b6aa]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b53ee9-6937-49b7-a6ac-ef69d4e3e603]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dYARhmkn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dYARhmkn" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42048c5-ac6c-4780-b491-ec3d221228e5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dYARhmkn'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c86e76-7497-4f8b-a762-29c6c1f44cc3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf76507-99ca-4dc6-a8ab-9852c17ca3c5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 05:56:20 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 05:56:20 user nova-compute[80928]:  {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:56:20 user nova-compute[80928]: WARNING os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 05:56:20 user nova-compute[80928]: 
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a66293-bd80-47ae-ac56-6d0637f37c13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814, portal: 172.16.0.220,3260]
Nov 16 05:56:20 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814, portal: 172.16.0.220,3260] successful.
Nov 16 05:56:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec602f05-9d16-40a7-ae26-7f107fe74e28]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7eaca60-14b0-47b5-ba67-6071e56497a9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 05:56:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 05:56:20 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9229b45c-17b4-4590-8539-69f9f5a21d11]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYARhmkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:56:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.618s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== connect_volume: return (1621ms) {'type': 'block', 'scsi_wwn': '26363383463646236', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363383463646236', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:56:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:56:21 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=9045MB free_disk=25.293193817138672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-731608245',display_name='tempest-TestVolumeBootPattern-volume-backed-server-731608245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-731608245',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOAe/uWwJ2uB8Tly+jijptHTKSuWlaDcyeK5Z6OaP1wN/oEQIPV5d9qAMsV9u/ljy+73kCD2zDQCI5AAWu9QQ6+e/LOc6HXJRdJUYfSRDUtvfEqnFcocol2bqU30stHYw==',key_name='tempest-keypair-1516066660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-43mzvah3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=5dc200e9-4a4e-47cd-be4a-905c2f34186e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:49:b1,bridge_name='br-int',has_traffic_filtering=True,id=18ac81db-3540-4b1f-b16e-3fbbaf2671cb,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ac81db-35') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.objects.instance [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dc200e9-4a4e-47cd-be4a-905c2f34186e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:56:21 user nova-compute[80928]:   <uuid>5dc200e9-4a4e-47cd-be4a-905c2f34186e</uuid>
Nov 16 05:56:21 user nova-compute[80928]:   <name>instance-00000029</name>
Nov 16 05:56:21 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:56:21 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:56:21 user nova-compute[80928]:   <metadata>
Nov 16 05:56:21 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:56:21 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:56:21 user nova-compute[80928]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-731608245</nova:name>
Nov 16 05:56:21 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:56:20</nova:creationTime>
Nov 16 05:56:21 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:56:21 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:56:21 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:56:21 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:56:21 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:56:21 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:56:21 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:56:21 user nova-compute[80928]:       <nova:owner>
Nov 16 05:56:21 user nova-compute[80928]:         <nova:user uuid="3613cf4088874d1699e1feee5f6edc9f">tempest-TestVolumeBootPattern-315833619-project-member</nova:user>
Nov 16 05:56:21 user nova-compute[80928]:         <nova:project uuid="4b90f29809d44adfb12039c9b7910275">tempest-TestVolumeBootPattern-315833619</nova:project>
Nov 16 05:56:21 user nova-compute[80928]:       </nova:owner>
Nov 16 05:56:21 user nova-compute[80928]:       <nova:ports>
Nov 16 05:56:21 user nova-compute[80928]:         <nova:port uuid="18ac81db-3540-4b1f-b16e-3fbbaf2671cb">
Nov 16 05:56:21 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 05:56:21 user nova-compute[80928]:         </nova:port>
Nov 16 05:56:21 user nova-compute[80928]:       </nova:ports>
Nov 16 05:56:21 user nova-compute[80928]:     </nova:instance>
Nov 16 05:56:21 user nova-compute[80928]:   </metadata>
Nov 16 05:56:21 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:56:21 user nova-compute[80928]:     <system>
Nov 16 05:56:21 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:56:21 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:56:21 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:56:21 user nova-compute[80928]:       <entry name="serial">5dc200e9-4a4e-47cd-be4a-905c2f34186e</entry>
Nov 16 05:56:21 user nova-compute[80928]:       <entry name="uuid">5dc200e9-4a4e-47cd-be4a-905c2f34186e</entry>
Nov 16 05:56:21 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:56:21 user nova-compute[80928]:     </system>
Nov 16 05:56:21 user nova-compute[80928]:   </sysinfo>
Nov 16 05:56:21 user nova-compute[80928]:   <os>
Nov 16 05:56:21 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:56:21 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:56:21 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:56:21 user nova-compute[80928]:   </os>
Nov 16 05:56:21 user nova-compute[80928]:   <features>
Nov 16 05:56:21 user nova-compute[80928]:     <acpi/>
Nov 16 05:56:21 user nova-compute[80928]:     <apic/>
Nov 16 05:56:21 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:56:21 user nova-compute[80928]:   </features>
Nov 16 05:56:21 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:56:21 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:56:21 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:56:21 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:56:21 user nova-compute[80928]:   </clock>
Nov 16 05:56:21 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:56:21 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:56:21 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:56:21 user nova-compute[80928]:   </cpu>
Nov 16 05:56:21 user nova-compute[80928]:   <devices>
Nov 16 05:56:21 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:56:21 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:56:21 user nova-compute[80928]:       <source dev="/dev/sdb"/>
Nov 16 05:56:21 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:56:21 user nova-compute[80928]:       <serial>f4412938-4663-4c36-8272-69a1814e6814</serial>
Nov 16 05:56:21 user nova-compute[80928]:     </disk>
Nov 16 05:56:21 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:56:21 user nova-compute[80928]:       <mac address="fa:16:3e:a8:49:b1"/>
Nov 16 05:56:21 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:56:21 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:56:21 user nova-compute[80928]:       <target dev="tap18ac81db-35"/>
Nov 16 05:56:21 user nova-compute[80928]:     </interface>
Nov 16 05:56:21 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:56:21 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/5dc200e9-4a4e-47cd-be4a-905c2f34186e/console.log" append="off"/>
Nov 16 05:56:21 user nova-compute[80928]:     </serial>
Nov 16 05:56:21 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:56:21 user nova-compute[80928]:     <video>
Nov 16 05:56:21 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:56:21 user nova-compute[80928]:     </video>
Nov 16 05:56:21 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:56:21 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:56:21 user nova-compute[80928]:     </rng>
Nov 16 05:56:21 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:56:21 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:56:21 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:56:21 user nova-compute[80928]:     </memballoon>
Nov 16 05:56:21 user nova-compute[80928]:   </devices>
Nov 16 05:56:21 user nova-compute[80928]: </domain>
Nov 16 05:56:21 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-731608245',display_name='tempest-TestVolumeBootPattern-volume-backed-server-731608245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-731608245',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOAe/uWwJ2uB8Tly+jijptHTKSuWlaDcyeK5Z6OaP1wN/oEQIPV5d9qAMsV9u/ljy+73kCD2zDQCI5AAWu9QQ6+e/LOc6HXJRdJUYfSRDUtvfEqnFcocol2bqU30stHYw==',key_name='tempest-keypair-1516066660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-43mzvah3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=5dc200e9-4a4e-47cd-be4a-905c2f34186e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:49:b1,bridge_name='br-int',has_traffic_filtering=True,id=18ac81db-3540-4b1f-b16e-3fbbaf2671cb,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ac81db-35') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG os_vif [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:49:b1,bridge_name='br-int',has_traffic_filtering=True,id=18ac81db-3540-4b1f-b16e-3fbbaf2671cb,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ac81db-35') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd336cbc1-e0a3-50b5-bb88-f1ac0134237b', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18ac81db-35, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18ac81db-35, col_values=(('qos', UUID('84e0026b-27d9-4245-b3f2-a09af48c28e4')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18ac81db-35, col_values=(('external_ids', {'iface-id': '18ac81db-3540-4b1f-b16e-3fbbaf2671cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:49:b1', 'vm-uuid': '5dc200e9-4a4e-47cd-be4a-905c2f34186e'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5dc200e9-4a4e-47cd-be4a-905c2f34186e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:21 user nova-compute[80928]: INFO os_vif [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:49:b1,bridge_name='br-int',has_traffic_filtering=True,id=18ac81db-3540-4b1f-b16e-3fbbaf2671cb,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ac81db-35')
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] No VIF found with MAC fa:16:3e:a8:49:b1, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:56:21 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-7e55cc1e-64a6-4a66-885e-a6aafe3a236a req-67f4b3ea-394e-4739-99f9-a20d166c03ad service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7e55cc1e-64a6-4a66-885e-a6aafe3a236a req-67f4b3ea-394e-4739-99f9-a20d166c03ad service nova] Acquiring lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7e55cc1e-64a6-4a66-885e-a6aafe3a236a req-67f4b3ea-394e-4739-99f9-a20d166c03ad service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7e55cc1e-64a6-4a66-885e-a6aafe3a236a req-67f4b3ea-394e-4739-99f9-a20d166c03ad service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-7e55cc1e-64a6-4a66-885e-a6aafe3a236a req-67f4b3ea-394e-4739-99f9-a20d166c03ad service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] No waiting events found dispatching network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:56:23 user nova-compute[80928]: WARNING nova.compute.manager [req-7e55cc1e-64a6-4a66-885e-a6aafe3a236a req-67f4b3ea-394e-4739-99f9-a20d166c03ad service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received unexpected event network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb for instance with vm_state building and task_state spawning.
Nov 16 05:56:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:24 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:56:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:56:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Instance spawned successfully.
Nov 16 05:56:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:56:25 user nova-compute[80928]: INFO nova.compute.manager [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 16 05:56:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:56:25 user nova-compute[80928]: INFO nova.compute.manager [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Took 10.60 seconds to build instance.
Nov 16 05:56:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4f61496f-31fa-4c00-804a-f66c6154aaf0 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.719s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-8d73ae48-a50f-4ec2-aa10-6145e2273a74 req-131b0619-e962-4f68-afe9-c1ad9c03b8db service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8d73ae48-a50f-4ec2-aa10-6145e2273a74 req-131b0619-e962-4f68-afe9-c1ad9c03b8db service nova] Acquiring lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8d73ae48-a50f-4ec2-aa10-6145e2273a74 req-131b0619-e962-4f68-afe9-c1ad9c03b8db service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8d73ae48-a50f-4ec2-aa10-6145e2273a74 req-131b0619-e962-4f68-afe9-c1ad9c03b8db service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-8d73ae48-a50f-4ec2-aa10-6145e2273a74 req-131b0619-e962-4f68-afe9-c1ad9c03b8db service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] No waiting events found dispatching network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:56:25 user nova-compute[80928]: WARNING nova.compute.manager [req-8d73ae48-a50f-4ec2-aa10-6145e2273a74 req-131b0619-e962-4f68-afe9-c1ad9c03b8db service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received unexpected event network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb for instance with vm_state active and task_state None.
Nov 16 05:56:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:31 user nova-compute[80928]: DEBUG nova.compute.manager [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:56:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:31 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:56:31 user nova-compute[80928]: INFO nova.compute.claims [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Claim successful on node user
Nov 16 05:56:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:31 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:56:31 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:56:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:31 user nova-compute[80928]: DEBUG nova.compute.manager [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:56:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:56:32 user nova-compute[80928]: DEBUG nova.network.neutron [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:56:32 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:56:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:56:32 user nova-compute[80928]: DEBUG nova.policy [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f68adc47ff640f6ae433684f457db57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab83b1fb4d343d08be479f5c56eb843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:56:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:56:32 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:56:32 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Creating image(s)
Nov 16 05:56:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "/opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "/opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "9040b1d08bf293a0a4769f4b2959a8645674d0f6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "9040b1d08bf293a0a4769f4b2959a8645674d0f6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6.part --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:32 user nova-compute[80928]: DEBUG nova.network.neutron [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Successfully created port: de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6.part --force-share --output=json" returned: 0 in 0.201s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG nova.virt.images [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] dda16e26-4629-4226-9d68-ab703faff3f3 was qcow2, converting to raw {{(pid=80928) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG nova.privsep.utils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=80928) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6.part /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6.converted {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6.part /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6.converted" returned: 0 in 0.272s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6.converted --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "9040b1d08bf293a0a4769f4b2959a8645674d0f6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.266s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG nova.network.neutron [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Successfully updated port: de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-4ba90d8d-9df4-4429-bb8e-51346eca116e req-3ef18353-1d25-4afb-bee4-0e69cc9fc740 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-changed-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-4ba90d8d-9df4-4429-bb8e-51346eca116e req-3ef18353-1d25-4afb-bee4-0e69cc9fc740 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Refreshing instance network info cache due to event network-changed-de3fe3b7-fb26-4218-9188-f50986f7b7f0. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4ba90d8d-9df4-4429-bb8e-51346eca116e req-3ef18353-1d25-4afb-bee4-0e69cc9fc740 service nova] Acquiring lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4ba90d8d-9df4-4429-bb8e-51346eca116e req-3ef18353-1d25-4afb-bee4-0e69cc9fc740 service nova] Acquired lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG nova.network.neutron [req-4ba90d8d-9df4-4429-bb8e-51346eca116e req-3ef18353-1d25-4afb-bee4-0e69cc9fc740 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Refreshing network info cache for port de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG nova.network.neutron [req-4ba90d8d-9df4-4429-bb8e-51346eca116e req-3ef18353-1d25-4afb-bee4-0e69cc9fc740 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6 --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "9040b1d08bf293a0a4769f4b2959a8645674d0f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "9040b1d08bf293a0a4769f4b2959a8645674d0f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG nova.network.neutron [req-4ba90d8d-9df4-4429-bb8e-51346eca116e req-3ef18353-1d25-4afb-bee4-0e69cc9fc740 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4ba90d8d-9df4-4429-bb8e-51346eca116e req-3ef18353-1d25-4afb-bee4-0e69cc9fc740 service nova] Releasing lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquired lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG nova.network.neutron [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6 --force-share --output=json" returned: 0 in 0.214s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6,backing_fmt=raw /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.network.neutron [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6,backing_fmt=raw /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk 1073741824" returned: 0 in 0.065s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "9040b1d08bf293a0a4769f4b2959a8645674d0f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6 --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.network.neutron [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updating instance_info_cache with network_info: [{"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Releasing lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.compute.manager [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Instance network_info: |[{"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Cannot resize image /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Ensure instance console log exists: /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Start _get_guest_xml network_info=[{"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:56:29Z,direct_url=<?>,disk_format='qcow2',id=dda16e26-4629-4226-9d68-ab703faff3f3,min_disk=0,min_ram=0,name='tempest-scenario-img--2063505470',owner='eab83b1fb4d343d08be479f5c56eb843',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:56:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'dda16e26-4629-4226-9d68-ab703faff3f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:56:34 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:56:34 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:56:29Z,direct_url=<?>,disk_format='qcow2',id=dda16e26-4629-4226-9d68-ab703faff3f3,min_disk=0,min_ram=0,name='tempest-scenario-img--2063505470',owner='eab83b1fb4d343d08be479f5c56eb843',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:56:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:56:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1149662607',display_name='tempest-TestMinimumBasicScenario-server-1149662607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1149662607',id=42,image_ref='dda16e26-4629-4226-9d68-ab703faff3f3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPsA+PjjEiOXdKih1zD2jnf6T4/UWDjjjVAGiPegJUGBQVN7pOUlHNw/XeM1fOw9BZuMk7gt7oSju2+kty2hkbF0UOiF/1kEQRdpHx0ZkNi1bv4LBupgosFUgSkODOMaQ==',key_name='tempest-TestMinimumBasicScenario-1828250359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eab83b1fb4d343d08be479f5c56eb843',ramdisk_id='',reservation_id='r-m43ropa8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dda16e26-4629-4226-9d68-ab703faff3f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-641847724',owner_user_name='tempest-TestMinimumBasicScenario-641847724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:56:32Z,user_data=None,user_id='6f68adc47ff640f6ae433684f457db57',uuid=2bf7b0af-49ef-4cda-92e7-cb1834ba739f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converting VIF {"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:41:d1,bridge_name='br-int',has_traffic_filtering=True,id=de3fe3b7-fb26-4218-9188-f50986f7b7f0,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3fe3b7-fb') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.objects.instance [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bf7b0af-49ef-4cda-92e7-cb1834ba739f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:56:34 user nova-compute[80928]:   <uuid>2bf7b0af-49ef-4cda-92e7-cb1834ba739f</uuid>
Nov 16 05:56:34 user nova-compute[80928]:   <name>instance-0000002a</name>
Nov 16 05:56:34 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:56:34 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:56:34 user nova-compute[80928]:   <metadata>
Nov 16 05:56:34 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:56:34 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:56:34 user nova-compute[80928]:       <nova:name>tempest-TestMinimumBasicScenario-server-1149662607</nova:name>
Nov 16 05:56:34 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:56:34</nova:creationTime>
Nov 16 05:56:34 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:56:34 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:56:34 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:56:34 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:56:34 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:56:34 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:56:34 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:56:34 user nova-compute[80928]:       <nova:owner>
Nov 16 05:56:34 user nova-compute[80928]:         <nova:user uuid="6f68adc47ff640f6ae433684f457db57">tempest-TestMinimumBasicScenario-641847724-project-member</nova:user>
Nov 16 05:56:34 user nova-compute[80928]:         <nova:project uuid="eab83b1fb4d343d08be479f5c56eb843">tempest-TestMinimumBasicScenario-641847724</nova:project>
Nov 16 05:56:34 user nova-compute[80928]:       </nova:owner>
Nov 16 05:56:34 user nova-compute[80928]:       <nova:root type="image" uuid="dda16e26-4629-4226-9d68-ab703faff3f3"/>
Nov 16 05:56:34 user nova-compute[80928]:       <nova:ports>
Nov 16 05:56:34 user nova-compute[80928]:         <nova:port uuid="de3fe3b7-fb26-4218-9188-f50986f7b7f0">
Nov 16 05:56:34 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 05:56:34 user nova-compute[80928]:         </nova:port>
Nov 16 05:56:34 user nova-compute[80928]:       </nova:ports>
Nov 16 05:56:34 user nova-compute[80928]:     </nova:instance>
Nov 16 05:56:34 user nova-compute[80928]:   </metadata>
Nov 16 05:56:34 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:56:34 user nova-compute[80928]:     <system>
Nov 16 05:56:34 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:56:34 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:56:34 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:56:34 user nova-compute[80928]:       <entry name="serial">2bf7b0af-49ef-4cda-92e7-cb1834ba739f</entry>
Nov 16 05:56:34 user nova-compute[80928]:       <entry name="uuid">2bf7b0af-49ef-4cda-92e7-cb1834ba739f</entry>
Nov 16 05:56:34 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:56:34 user nova-compute[80928]:     </system>
Nov 16 05:56:34 user nova-compute[80928]:   </sysinfo>
Nov 16 05:56:34 user nova-compute[80928]:   <os>
Nov 16 05:56:34 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:56:34 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:56:34 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:56:34 user nova-compute[80928]:   </os>
Nov 16 05:56:34 user nova-compute[80928]:   <features>
Nov 16 05:56:34 user nova-compute[80928]:     <acpi/>
Nov 16 05:56:34 user nova-compute[80928]:     <apic/>
Nov 16 05:56:34 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:56:34 user nova-compute[80928]:   </features>
Nov 16 05:56:34 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:56:34 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:56:34 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:56:34 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:56:34 user nova-compute[80928]:   </clock>
Nov 16 05:56:34 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:56:34 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:56:34 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:56:34 user nova-compute[80928]:   </cpu>
Nov 16 05:56:34 user nova-compute[80928]:   <devices>
Nov 16 05:56:34 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:56:34 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:56:34 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk"/>
Nov 16 05:56:34 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:56:34 user nova-compute[80928]:     </disk>
Nov 16 05:56:34 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:56:34 user nova-compute[80928]:       <mac address="fa:16:3e:82:41:d1"/>
Nov 16 05:56:34 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:56:34 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:56:34 user nova-compute[80928]:       <target dev="tapde3fe3b7-fb"/>
Nov 16 05:56:34 user nova-compute[80928]:     </interface>
Nov 16 05:56:34 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:56:34 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/console.log" append="off"/>
Nov 16 05:56:34 user nova-compute[80928]:     </serial>
Nov 16 05:56:34 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:56:34 user nova-compute[80928]:     <video>
Nov 16 05:56:34 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:56:34 user nova-compute[80928]:     </video>
Nov 16 05:56:34 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:56:34 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:56:34 user nova-compute[80928]:     </rng>
Nov 16 05:56:34 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:56:34 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:56:34 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:56:34 user nova-compute[80928]:     </memballoon>
Nov 16 05:56:34 user nova-compute[80928]:   </devices>
Nov 16 05:56:34 user nova-compute[80928]: </domain>
Nov 16 05:56:34 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:56:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1149662607',display_name='tempest-TestMinimumBasicScenario-server-1149662607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1149662607',id=42,image_ref='dda16e26-4629-4226-9d68-ab703faff3f3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPsA+PjjEiOXdKih1zD2jnf6T4/UWDjjjVAGiPegJUGBQVN7pOUlHNw/XeM1fOw9BZuMk7gt7oSju2+kty2hkbF0UOiF/1kEQRdpHx0ZkNi1bv4LBupgosFUgSkODOMaQ==',key_name='tempest-TestMinimumBasicScenario-1828250359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eab83b1fb4d343d08be479f5c56eb843',ramdisk_id='',reservation_id='r-m43ropa8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dda16e26-4629-4226-9d68-ab703faff3f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-641847724',owner_user_name='tempest-TestMinimumBasicScenario-641847724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:56:32Z,user_data=None,user_id='6f68adc47ff640f6ae433684f457db57',uuid=2bf7b0af-49ef-4cda-92e7-cb1834ba739f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converting VIF {"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:41:d1,bridge_name='br-int',has_traffic_filtering=True,id=de3fe3b7-fb26-4218-9188-f50986f7b7f0,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3fe3b7-fb') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG os_vif [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:41:d1,bridge_name='br-int',has_traffic_filtering=True,id=de3fe3b7-fb26-4218-9188-f50986f7b7f0,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3fe3b7-fb') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab3d0b85-0767-54fd-a953-2d9a259a0e60', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde3fe3b7-fb, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde3fe3b7-fb, col_values=(('qos', UUID('025dab04-80ab-425a-a5cb-3ee0cc7eba85')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde3fe3b7-fb, col_values=(('external_ids', {'iface-id': 'de3fe3b7-fb26-4218-9188-f50986f7b7f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:41:d1', 'vm-uuid': '2bf7b0af-49ef-4cda-92e7-cb1834ba739f'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:34 user nova-compute[80928]: INFO os_vif [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:41:d1,bridge_name='br-int',has_traffic_filtering=True,id=de3fe3b7-fb26-4218-9188-f50986f7b7f0,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3fe3b7-fb')
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:56:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] No VIF found with MAC fa:16:3e:82:41:d1, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:56:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:36 user nova-compute[80928]: DEBUG nova.compute.manager [req-0e19263f-1a15-4a1b-8331-c855f5e781e8 req-d69a117b-d432-48c7-8f23-987a1a4c98f1 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:56:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0e19263f-1a15-4a1b-8331-c855f5e781e8 req-d69a117b-d432-48c7-8f23-987a1a4c98f1 service nova] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0e19263f-1a15-4a1b-8331-c855f5e781e8 req-d69a117b-d432-48c7-8f23-987a1a4c98f1 service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0e19263f-1a15-4a1b-8331-c855f5e781e8 req-d69a117b-d432-48c7-8f23-987a1a4c98f1 service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:36 user nova-compute[80928]: DEBUG nova.compute.manager [req-0e19263f-1a15-4a1b-8331-c855f5e781e8 req-d69a117b-d432-48c7-8f23-987a1a4c98f1 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] No waiting events found dispatching network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:56:36 user nova-compute[80928]: WARNING nova.compute.manager [req-0e19263f-1a15-4a1b-8331-c855f5e781e8 req-d69a117b-d432-48c7-8f23-987a1a4c98f1 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received unexpected event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 for instance with vm_state building and task_state spawning.
Nov 16 05:56:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:56:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Instance spawned successfully.
Nov 16 05:56:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:56:38 user nova-compute[80928]: INFO nova.compute.manager [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 16 05:56:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:56:38 user nova-compute[80928]: INFO nova.compute.manager [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Took 6.72 seconds to build instance.
Nov 16 05:56:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-add799f2-0257-4910-8d6e-39354013d53f tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.010s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-69567ae3-16f6-4b0c-8738-49b35a797c5c req-27498b04-334a-40d7-902e-fd4b5ea159da service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-69567ae3-16f6-4b0c-8738-49b35a797c5c req-27498b04-334a-40d7-902e-fd4b5ea159da service nova] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-69567ae3-16f6-4b0c-8738-49b35a797c5c req-27498b04-334a-40d7-902e-fd4b5ea159da service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-69567ae3-16f6-4b0c-8738-49b35a797c5c req-27498b04-334a-40d7-902e-fd4b5ea159da service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:56:38 user nova-compute[80928]: DEBUG nova.compute.manager [req-69567ae3-16f6-4b0c-8738-49b35a797c5c req-27498b04-334a-40d7-902e-fd4b5ea159da service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] No waiting events found dispatching network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:56:38 user nova-compute[80928]: WARNING nova.compute.manager [req-69567ae3-16f6-4b0c-8738-49b35a797c5c req-27498b04-334a-40d7-902e-fd4b5ea159da service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received unexpected event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 for instance with vm_state active and task_state None.
Nov 16 05:56:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquired lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'info_cache' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.objects.base [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updating instance_info_cache with network_info: [{"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Releasing lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:56:58 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance destroyed successfully.
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'resources' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.objects.base [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache,resources {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1608335381',display_name='tempest-AttachVolumeTestJSON-server-1608335381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1608335381',id=38,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIheiaIxPwP6SA4L1FNfT/iVP2oIcKbZWevRs6N7x4qvsfqzxVVfO6fF8zGk5rw0ndDEv99BxFLQjD1+Tt+oqfeijNH8TrsvSWOfBX1YC4BXEZkch1QPW+6pCo5Kkt1+w==',key_name='tempest-keypair-845255928',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05d6e74da88a497ca920dcb2e07ea05a',ramdisk_id='',reservation_id='r-yk964sbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1530907565',owner_user_name='tempest-AttachVolumeTestJSON-1530907565-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:55:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be30aca2412b475498f99dddb86c5983',uuid=35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converting VIF {"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG os_vif [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7453ccbb-c8, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df88ade9-26d6-4fa2-bba4-f2220c572404) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:58 user nova-compute[80928]: INFO os_vif [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8')
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Start _get_guest_xml network_info=[{"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'numa_topology' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.objects.base [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:56:58 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:56:58 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'vcpu_model' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.objects.base [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1608335381',display_name='tempest-AttachVolumeTestJSON-server-1608335381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1608335381',id=38,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIheiaIxPwP6SA4L1FNfT/iVP2oIcKbZWevRs6N7x4qvsfqzxVVfO6fF8zGk5rw0ndDEv99BxFLQjD1+Tt+oqfeijNH8TrsvSWOfBX1YC4BXEZkch1QPW+6pCo5Kkt1+w==',key_name='tempest-keypair-845255928',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05d6e74da88a497ca920dcb2e07ea05a',ramdisk_id='',reservation_id='r-yk964sbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1530907565',owner_user_name='tempest-AttachVolumeTestJSON-1530907565-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:55:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be30aca2412b475498f99dddb86c5983',uuid=35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converting VIF {"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'pci_devices' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.objects.base [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:56:58 user nova-compute[80928]:   <uuid>35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7</uuid>
Nov 16 05:56:58 user nova-compute[80928]:   <name>instance-00000026</name>
Nov 16 05:56:58 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:56:58 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:56:58 user nova-compute[80928]:   <metadata>
Nov 16 05:56:58 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:56:58 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:56:58 user nova-compute[80928]:       <nova:name>tempest-AttachVolumeTestJSON-server-1608335381</nova:name>
Nov 16 05:56:58 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:56:58</nova:creationTime>
Nov 16 05:56:58 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:56:58 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:56:58 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:56:58 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:56:58 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:56:58 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:56:58 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:56:58 user nova-compute[80928]:       <nova:owner>
Nov 16 05:56:58 user nova-compute[80928]:         <nova:user uuid="be30aca2412b475498f99dddb86c5983">tempest-AttachVolumeTestJSON-1530907565-project-member</nova:user>
Nov 16 05:56:58 user nova-compute[80928]:         <nova:project uuid="05d6e74da88a497ca920dcb2e07ea05a">tempest-AttachVolumeTestJSON-1530907565</nova:project>
Nov 16 05:56:58 user nova-compute[80928]:       </nova:owner>
Nov 16 05:56:58 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:56:58 user nova-compute[80928]:       <nova:ports>
Nov 16 05:56:58 user nova-compute[80928]:         <nova:port uuid="7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5">
Nov 16 05:56:58 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 05:56:58 user nova-compute[80928]:         </nova:port>
Nov 16 05:56:58 user nova-compute[80928]:       </nova:ports>
Nov 16 05:56:58 user nova-compute[80928]:     </nova:instance>
Nov 16 05:56:58 user nova-compute[80928]:   </metadata>
Nov 16 05:56:58 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:56:58 user nova-compute[80928]:     <system>
Nov 16 05:56:58 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:56:58 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:56:58 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:56:58 user nova-compute[80928]:       <entry name="serial">35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7</entry>
Nov 16 05:56:58 user nova-compute[80928]:       <entry name="uuid">35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7</entry>
Nov 16 05:56:58 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:56:58 user nova-compute[80928]:     </system>
Nov 16 05:56:58 user nova-compute[80928]:   </sysinfo>
Nov 16 05:56:58 user nova-compute[80928]:   <os>
Nov 16 05:56:58 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:56:58 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:56:58 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:56:58 user nova-compute[80928]:   </os>
Nov 16 05:56:58 user nova-compute[80928]:   <features>
Nov 16 05:56:58 user nova-compute[80928]:     <acpi/>
Nov 16 05:56:58 user nova-compute[80928]:     <apic/>
Nov 16 05:56:58 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:56:58 user nova-compute[80928]:   </features>
Nov 16 05:56:58 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:56:58 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:56:58 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:56:58 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:56:58 user nova-compute[80928]:   </clock>
Nov 16 05:56:58 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:56:58 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:56:58 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:56:58 user nova-compute[80928]:   </cpu>
Nov 16 05:56:58 user nova-compute[80928]:   <devices>
Nov 16 05:56:58 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:56:58 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:56:58 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk"/>
Nov 16 05:56:58 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:56:58 user nova-compute[80928]:     </disk>
Nov 16 05:56:58 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:56:58 user nova-compute[80928]:       <mac address="fa:16:3e:86:53:a9"/>
Nov 16 05:56:58 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:56:58 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:56:58 user nova-compute[80928]:       <target dev="tap7453ccbb-c8"/>
Nov 16 05:56:58 user nova-compute[80928]:     </interface>
Nov 16 05:56:58 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:56:58 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/console.log" append="off"/>
Nov 16 05:56:58 user nova-compute[80928]:     </serial>
Nov 16 05:56:58 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:56:58 user nova-compute[80928]:     <video>
Nov 16 05:56:58 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:56:58 user nova-compute[80928]:     </video>
Nov 16 05:56:58 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:56:58 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:56:58 user nova-compute[80928]:     </rng>
Nov 16 05:56:58 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:56:58 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:56:58 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:56:58 user nova-compute[80928]:     </memballoon>
Nov 16 05:56:58 user nova-compute[80928]:   </devices>
Nov 16 05:56:58 user nova-compute[80928]: </domain>
Nov 16 05:56:58 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:56:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG nova.objects.instance [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'trusted_certs' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG nova.objects.base [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Cannot resize image /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG nova.objects.instance [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'migration_context' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG nova.objects.base [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Object Instance<35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=80928) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1608335381',display_name='tempest-AttachVolumeTestJSON-server-1608335381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1608335381',id=38,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIheiaIxPwP6SA4L1FNfT/iVP2oIcKbZWevRs6N7x4qvsfqzxVVfO6fF8zGk5rw0ndDEv99BxFLQjD1+Tt+oqfeijNH8TrsvSWOfBX1YC4BXEZkch1QPW+6pCo5Kkt1+w==',key_name='tempest-keypair-845255928',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='05d6e74da88a497ca920dcb2e07ea05a',ramdisk_id='',reservation_id='r-yk964sbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1530907565',owner_user_name='tempest-AttachVolumeTestJSON-1530907565-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:55:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be30aca2412b475498f99dddb86c5983',uuid=35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converting VIF {"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG os_vif [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50d70bc0-7b04-5cff-8efb-69c0a29cf2a8', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7453ccbb-c8, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7453ccbb-c8, col_values=(('qos', UUID('15ea9554-d550-4a62-8f4c-b720176c05bb')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7453ccbb-c8, col_values=(('external_ids', {'iface-id': '7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:53:a9', 'vm-uuid': '35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:56:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:56:59 user nova-compute[80928]: INFO os_vif [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8')
Nov 16 05:57:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-50584f14-c6df-4c25-9b6b-5d999f329e9b req-2cb1f6e6-b441-4d86-918d-ced69c0b8ddf service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:57:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-50584f14-c6df-4c25-9b6b-5d999f329e9b req-2cb1f6e6-b441-4d86-918d-ced69c0b8ddf service nova] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:57:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-50584f14-c6df-4c25-9b6b-5d999f329e9b req-2cb1f6e6-b441-4d86-918d-ced69c0b8ddf service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:57:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-50584f14-c6df-4c25-9b6b-5d999f329e9b req-2cb1f6e6-b441-4d86-918d-ced69c0b8ddf service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:57:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-50584f14-c6df-4c25-9b6b-5d999f329e9b req-2cb1f6e6-b441-4d86-918d-ced69c0b8ddf service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] No waiting events found dispatching network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:57:01 user nova-compute[80928]: WARNING nova.compute.manager [req-50584f14-c6df-4c25-9b6b-5d999f329e9b req-2cb1f6e6-b441-4d86-918d-ced69c0b8ddf service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received unexpected event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 for instance with vm_state stopped and task_state powering-on.
Nov 16 05:57:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:57:03 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance rebooted successfully.
Nov 16 05:57:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-4a78d2bc-d388-4975-9052-85dbb361ee45 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:57:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-28d035f2-5b66-442e-9b26-bad5b631d104 req-08100254-41fe-43de-99c6-2cd8e328a522 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:57:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-28d035f2-5b66-442e-9b26-bad5b631d104 req-08100254-41fe-43de-99c6-2cd8e328a522 service nova] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:57:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-28d035f2-5b66-442e-9b26-bad5b631d104 req-08100254-41fe-43de-99c6-2cd8e328a522 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:57:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-28d035f2-5b66-442e-9b26-bad5b631d104 req-08100254-41fe-43de-99c6-2cd8e328a522 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:57:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-28d035f2-5b66-442e-9b26-bad5b631d104 req-08100254-41fe-43de-99c6-2cd8e328a522 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] No waiting events found dispatching network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:57:03 user nova-compute[80928]: WARNING nova.compute.manager [req-28d035f2-5b66-442e-9b26-bad5b631d104 req-08100254-41fe-43de-99c6-2cd8e328a522 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received unexpected event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 for instance with vm_state active and task_state None.
Nov 16 05:57:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:07 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:57:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:13 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:57:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:57:15 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:57:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:16 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:57:17 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:57:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:57:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:57:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:57:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:57:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:57:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:57:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:57:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:57:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:57:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:57:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:57:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:57:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:57:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:57:22 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:57:22 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:57:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8579MB free_disk=25.225826263427734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:57:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:57:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:57:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:57:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5dc200e9-4a4e-47cd-be4a-905c2f34186e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:57:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2bf7b0af-49ef-4cda-92e7-cb1834ba739f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:57:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:57:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:57:22 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:57:22 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:57:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:57:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:57:23 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:57:23 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:57:23 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 05:57:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:57:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:57:23 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:57:23 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:57:23 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updating instance_info_cache with network_info: [{"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:57:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:57:23 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:57:23 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:57:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:26 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:57:26 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:57:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:57:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:57:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:57:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:57:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:57:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:57:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:57:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:57:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:57:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:57:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:57:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:57:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:58:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 05:58:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:58:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 05:58:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:05 user nova-compute[80928]: DEBUG nova.compute.manager [req-17642e5a-4bdc-4915-9a7c-19ba243db890 req-f5c1660a-9974-4ddd-b781-265e81129d3c service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-changed-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:05 user nova-compute[80928]: DEBUG nova.compute.manager [req-17642e5a-4bdc-4915-9a7c-19ba243db890 req-f5c1660a-9974-4ddd-b781-265e81129d3c service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Refreshing instance network info cache due to event network-changed-18ac81db-3540-4b1f-b16e-3fbbaf2671cb. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:58:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-17642e5a-4bdc-4915-9a7c-19ba243db890 req-f5c1660a-9974-4ddd-b781-265e81129d3c service nova] Acquiring lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:58:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-17642e5a-4bdc-4915-9a7c-19ba243db890 req-f5c1660a-9974-4ddd-b781-265e81129d3c service nova] Acquired lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:58:05 user nova-compute[80928]: DEBUG nova.network.neutron [req-17642e5a-4bdc-4915-9a7c-19ba243db890 req-f5c1660a-9974-4ddd-b781-265e81129d3c service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Refreshing network info cache for port 18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:58:05 user nova-compute[80928]: DEBUG nova.network.neutron [req-17642e5a-4bdc-4915-9a7c-19ba243db890 req-f5c1660a-9974-4ddd-b781-265e81129d3c service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Updated VIF entry in instance network info cache for port 18ac81db-3540-4b1f-b16e-3fbbaf2671cb. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:58:05 user nova-compute[80928]: DEBUG nova.network.neutron [req-17642e5a-4bdc-4915-9a7c-19ba243db890 req-f5c1660a-9974-4ddd-b781-265e81129d3c service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Updating instance_info_cache with network_info: [{"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:58:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-17642e5a-4bdc-4915-9a7c-19ba243db890 req-f5c1660a-9974-4ddd-b781-265e81129d3c service nova] Releasing lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:58:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:08 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:58:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:11 user nova-compute[80928]: DEBUG nova.compute.manager [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:58:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:11 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:58:11 user nova-compute[80928]: INFO nova.compute.claims [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Claim successful on node user
Nov 16 05:58:11 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:58:11 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:58:11 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:11 user nova-compute[80928]: DEBUG nova.compute.manager [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:58:11 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:58:11 user nova-compute[80928]: DEBUG nova.compute.manager [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:58:11 user nova-compute[80928]: DEBUG nova.network.neutron [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:58:11 user nova-compute[80928]: DEBUG nova.compute.manager [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:58:11 user nova-compute[80928]: INFO nova.virt.block_device [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Booting with volume snapshot 548305b0-4281-446a-9bf6-10ffef606a24 at /dev/vda
Nov 16 05:58:11 user nova-compute[80928]: DEBUG nova.policy [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3613cf4088874d1699e1feee5f6edc9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90f29809d44adfb12039c9b7910275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:58:12 user nova-compute[80928]: DEBUG nova.network.neutron [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Successfully created port: a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG nova.network.neutron [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Successfully updated port: a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "refresh_cache-f624d1c4-18d4-4f1f-99e9-4f18f05295ef" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquired lock "refresh_cache-f624d1c4-18d4-4f1f-99e9-4f18f05295ef" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG nova.network.neutron [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-1698e531-4ec4-4ce9-a982-3232ba21211f req-75e5a06c-46f8-48ae-8696-7b318ffc6d21 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Received event network-changed-a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-1698e531-4ec4-4ce9-a982-3232ba21211f req-75e5a06c-46f8-48ae-8696-7b318ffc6d21 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Refreshing instance network info cache due to event network-changed-a656f581-e84f-4097-b646-b62dfe641cc5. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1698e531-4ec4-4ce9-a982-3232ba21211f req-75e5a06c-46f8-48ae-8696-7b318ffc6d21 service nova] Acquiring lock "refresh_cache-f624d1c4-18d4-4f1f-99e9-4f18f05295ef" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG nova.network.neutron [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG nova.network.neutron [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Updating instance_info_cache with network_info: [{"id": "a656f581-e84f-4097-b646-b62dfe641cc5", "address": "fa:16:3e:a1:3a:51", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa656f581-e8", "ovs_interfaceid": "a656f581-e84f-4097-b646-b62dfe641cc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Releasing lock "refresh_cache-f624d1c4-18d4-4f1f-99e9-4f18f05295ef" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Instance network_info: |[{"id": "a656f581-e84f-4097-b646-b62dfe641cc5", "address": "fa:16:3e:a1:3a:51", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa656f581-e8", "ovs_interfaceid": "a656f581-e84f-4097-b646-b62dfe641cc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1698e531-4ec4-4ce9-a982-3232ba21211f req-75e5a06c-46f8-48ae-8696-7b318ffc6d21 service nova] Acquired lock "refresh_cache-f624d1c4-18d4-4f1f-99e9-4f18f05295ef" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG nova.network.neutron [req-1698e531-4ec4-4ce9-a982-3232ba21211f req-75e5a06c-46f8-48ae-8696-7b318ffc6d21 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Refreshing network info cache for port a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG nova.network.neutron [req-1698e531-4ec4-4ce9-a982-3232ba21211f req-75e5a06c-46f8-48ae-8696-7b318ffc6d21 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Updated VIF entry in instance network info cache for port a656f581-e84f-4097-b646-b62dfe641cc5. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG nova.network.neutron [req-1698e531-4ec4-4ce9-a982-3232ba21211f req-75e5a06c-46f8-48ae-8696-7b318ffc6d21 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Updating instance_info_cache with network_info: [{"id": "a656f581-e84f-4097-b646-b62dfe641cc5", "address": "fa:16:3e:a1:3a:51", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa656f581-e8", "ovs_interfaceid": "a656f581-e84f-4097-b646-b62dfe641cc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:58:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1698e531-4ec4-4ce9-a982-3232ba21211f req-75e5a06c-46f8-48ae-8696-7b318ffc6d21 service nova] Releasing lock "refresh_cache-f624d1c4-18d4-4f1f-99e9-4f18f05295ef" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:58:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:58:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:16 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:58:16 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG os_brick.utils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11d4c7b-d0d4-4f2a-b213-040962b38e91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[442900f6-56b6-4559-a0bd-4a0c7e7080b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[299a7164-14e4-44f7-88fd-5d77d7d806f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[22903a6b-3a62-49a9-bb83-0b4b09459afc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:58:17 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca6dc4e-39e8-437e-bbb8-e031753d9761]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG os_brick.utils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Updating existing volume attachment record: d8ac2191-495e-4f06-a712-272a4e183725 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:58:17 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:58:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:58:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:20 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:58:20 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:58:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:22 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:58:22 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8735MB free_disk=25.224292755126953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5dc200e9-4a4e-47cd-be4a-905c2f34186e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2bf7b0af-49ef-4cda-92e7-cb1834ba739f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance f624d1c4-18d4-4f1f-99e9-4f18f05295ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:58:22 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Creating image(s)
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Ensure instance console log exists: /opt/stack/data/nova/instances/f624d1c4-18d4-4f1f-99e9-4f18f05295ef/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Start _get_guest_xml network_info=[{"id": "a656f581-e84f-4097-b646-b62dfe641cc5", "address": "fa:16:3e:a1:3a:51", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa656f581-e8", "ovs_interfaceid": "a656f581-e84f-4097-b646-b62dfe641cc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T05:58:07Z,direct_url=<?>,disk_format='qcow2',id=b7d650d5-dd80-4fd9-81ce-2c3538839207,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-63345293',owner='4b90f29809d44adfb12039c9b7910275',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T05:58:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGanZQBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f624d1c4-18d4-4f1f-99e9-4f18f05295ef', 'attached_at': '', 'detached_at': '', 'volume_id': '14b24331-60c9-4693-ab0c-71f71a4737d3', 'serial': '14b24331-60c9-4693-ab0c-71f71a4737d3'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd8ac2191-495e-4f06-a712-272a4e183725', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:58:22 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:58:22 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T05:58:07Z,direct_url=<?>,disk_format='qcow2',id=b7d650d5-dd80-4fd9-81ce-2c3538839207,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-63345293',owner='4b90f29809d44adfb12039c9b7910275',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T05:58:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGanZQBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:58:22 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:58:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:58:22 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:58:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:58:22 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[05531d37-7927-4e2d-a75f-eca63e4fd279]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:58:22 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[984e3aa5-c384-4230-8a1b-eeca204e7be2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3] added
Nov 16 05:58:22 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d140e263-23de-4b7e-a443-cad74088c0ef]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6887a3-daeb-4d71-b544-84879d84f868]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGanZQBX {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGanZQBX" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[34db2ce8-338b-4ae3-a570-5a34423df721]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eGanZQBX'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc0254a-d686-4f5d-aeea-ddf225bc41e3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cf0926-3853-4797-89bd-b3321a502b09]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 05:58:22 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 05:58:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24da3d0-7663-44b9-ae02-0e4b137bf09e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3, portal: 172.16.0.220,3260]
Nov 16 05:58:23 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3, portal: 172.16.0.220,3260] successful.
Nov 16 05:58:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac190b6-16ce-4538-abe3-cc733273cfce]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7775c9e-8e9d-4103-a8a5-7eb257573685]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 05:58:23 user nova-compute[80928]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 (non-flash)
Nov 16 05:58:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 05:58:23 user nova-compute[80928]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 (non-flash)
Nov 16 05:58:23 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72ca14c-f1b4-46d6-a409-2bc5b7f0aa71]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGanZQBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG nova.objects.instance [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'flavor' on Instance uuid 2bf7b0af-49ef-4cda-92e7-cb1834ba739f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:23 user nova-compute[80928]: INFO nova.compute.manager [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Attaching volume 955878dc-c623-4dc9-a090-fd7273b34afe to /dev/vdb
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.utils [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[76db82f9-2258-4a49-89a0-99c080cbf50d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb201bd-b32f-40a9-a92f-91b06b381dec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e85c85-8526-4e2f-b931-ec2c10d0d518]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a85e9a6-996e-4aab-abb9-aba74a0163db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 05:58:23 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 05:58:23 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4592a437-16d6-43b8-a9da-b4e622c53d38]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG os_brick.utils [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updating existing volume attachment record: ee859390-612f-43f0-ba2b-583ca9544a35 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26661363066386337', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661363066386337', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-450726560',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-450726560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-450726560',id=43,image_ref='b7d650d5-dd80-4fd9-81ce-2c3538839207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKIDGw7lOd9v5fgfeaXUinGd/FsnNu9fFW7Hv6Y3eJ0m6De+YePibxHvJdPWjm3ouLQnxdued3mk5xI/udB/MinzlvREoLuvaqsSVCc1q/KTjEgypx0+B4lGHxqXMUCFg==',key_name='tempest-keypair-990253658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-f7665blw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-315833619',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=f624d1c4-18d4-4f1f-99e9-4f18f05295ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a656f581-e84f-4097-b646-b62dfe641cc5", "address": "fa:16:3e:a1:3a:51", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa656f581-e8", "ovs_interfaceid": "a656f581-e84f-4097-b646-b62dfe641cc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "a656f581-e84f-4097-b646-b62dfe641cc5", "address": "fa:16:3e:a1:3a:51", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa656f581-e8", "ovs_interfaceid": "a656f581-e84f-4097-b646-b62dfe641cc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3a:51,bridge_name='br-int',has_traffic_filtering=True,id=a656f581-e84f-4097-b646-b62dfe641cc5,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa656f581-e8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.objects.instance [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lazy-loading 'pci_devices' on Instance uuid f624d1c4-18d4-4f1f-99e9-4f18f05295ef {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:58:24 user nova-compute[80928]:   <uuid>f624d1c4-18d4-4f1f-99e9-4f18f05295ef</uuid>
Nov 16 05:58:24 user nova-compute[80928]:   <name>instance-0000002b</name>
Nov 16 05:58:24 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:58:24 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:58:24 user nova-compute[80928]:   <metadata>
Nov 16 05:58:24 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:58:24 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:58:24 user nova-compute[80928]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-450726560</nova:name>
Nov 16 05:58:24 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:58:22</nova:creationTime>
Nov 16 05:58:24 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:58:24 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:58:24 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:58:24 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:58:24 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:58:24 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:58:24 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:58:24 user nova-compute[80928]:       <nova:owner>
Nov 16 05:58:24 user nova-compute[80928]:         <nova:user uuid="3613cf4088874d1699e1feee5f6edc9f">tempest-TestVolumeBootPattern-315833619-project-member</nova:user>
Nov 16 05:58:24 user nova-compute[80928]:         <nova:project uuid="4b90f29809d44adfb12039c9b7910275">tempest-TestVolumeBootPattern-315833619</nova:project>
Nov 16 05:58:24 user nova-compute[80928]:       </nova:owner>
Nov 16 05:58:24 user nova-compute[80928]:       <nova:root type="image" uuid="b7d650d5-dd80-4fd9-81ce-2c3538839207"/>
Nov 16 05:58:24 user nova-compute[80928]:       <nova:ports>
Nov 16 05:58:24 user nova-compute[80928]:         <nova:port uuid="a656f581-e84f-4097-b646-b62dfe641cc5">
Nov 16 05:58:24 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 05:58:24 user nova-compute[80928]:         </nova:port>
Nov 16 05:58:24 user nova-compute[80928]:       </nova:ports>
Nov 16 05:58:24 user nova-compute[80928]:     </nova:instance>
Nov 16 05:58:24 user nova-compute[80928]:   </metadata>
Nov 16 05:58:24 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:58:24 user nova-compute[80928]:     <system>
Nov 16 05:58:24 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:58:24 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:58:24 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:58:24 user nova-compute[80928]:       <entry name="serial">f624d1c4-18d4-4f1f-99e9-4f18f05295ef</entry>
Nov 16 05:58:24 user nova-compute[80928]:       <entry name="uuid">f624d1c4-18d4-4f1f-99e9-4f18f05295ef</entry>
Nov 16 05:58:24 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:58:24 user nova-compute[80928]:     </system>
Nov 16 05:58:24 user nova-compute[80928]:   </sysinfo>
Nov 16 05:58:24 user nova-compute[80928]:   <os>
Nov 16 05:58:24 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:58:24 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:58:24 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:58:24 user nova-compute[80928]:   </os>
Nov 16 05:58:24 user nova-compute[80928]:   <features>
Nov 16 05:58:24 user nova-compute[80928]:     <acpi/>
Nov 16 05:58:24 user nova-compute[80928]:     <apic/>
Nov 16 05:58:24 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:58:24 user nova-compute[80928]:   </features>
Nov 16 05:58:24 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:58:24 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:58:24 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:58:24 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:58:24 user nova-compute[80928]:   </clock>
Nov 16 05:58:24 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:58:24 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:58:24 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:58:24 user nova-compute[80928]:   </cpu>
Nov 16 05:58:24 user nova-compute[80928]:   <devices>
Nov 16 05:58:24 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 05:58:24 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:58:24 user nova-compute[80928]:       <source dev="/dev/sdc"/>
Nov 16 05:58:24 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:58:24 user nova-compute[80928]:       <serial>14b24331-60c9-4693-ab0c-71f71a4737d3</serial>
Nov 16 05:58:24 user nova-compute[80928]:     </disk>
Nov 16 05:58:24 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:58:24 user nova-compute[80928]:       <mac address="fa:16:3e:a1:3a:51"/>
Nov 16 05:58:24 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:58:24 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:58:24 user nova-compute[80928]:       <target dev="tapa656f581-e8"/>
Nov 16 05:58:24 user nova-compute[80928]:     </interface>
Nov 16 05:58:24 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:58:24 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/f624d1c4-18d4-4f1f-99e9-4f18f05295ef/console.log" append="off"/>
Nov 16 05:58:24 user nova-compute[80928]:     </serial>
Nov 16 05:58:24 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:58:24 user nova-compute[80928]:     <video>
Nov 16 05:58:24 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:58:24 user nova-compute[80928]:     </video>
Nov 16 05:58:24 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:58:24 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:58:24 user nova-compute[80928]:     </rng>
Nov 16 05:58:24 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:58:24 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:58:24 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:58:24 user nova-compute[80928]:     </memballoon>
Nov 16 05:58:24 user nova-compute[80928]:   </devices>
Nov 16 05:58:24 user nova-compute[80928]: </domain>
Nov 16 05:58:24 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-450726560',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-450726560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-450726560',id=43,image_ref='b7d650d5-dd80-4fd9-81ce-2c3538839207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKIDGw7lOd9v5fgfeaXUinGd/FsnNu9fFW7Hv6Y3eJ0m6De+YePibxHvJdPWjm3ouLQnxdued3mk5xI/udB/MinzlvREoLuvaqsSVCc1q/KTjEgypx0+B4lGHxqXMUCFg==',key_name='tempest-keypair-990253658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-f7665blw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-315833619',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=f624d1c4-18d4-4f1f-99e9-4f18f05295ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a656f581-e84f-4097-b646-b62dfe641cc5", "address": "fa:16:3e:a1:3a:51", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa656f581-e8", "ovs_interfaceid": "a656f581-e84f-4097-b646-b62dfe641cc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "a656f581-e84f-4097-b646-b62dfe641cc5", "address": "fa:16:3e:a1:3a:51", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa656f581-e8", "ovs_interfaceid": "a656f581-e84f-4097-b646-b62dfe641cc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3a:51,bridge_name='br-int',has_traffic_filtering=True,id=a656f581-e84f-4097-b646-b62dfe641cc5,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa656f581-e8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG os_vif [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3a:51,bridge_name='br-int',has_traffic_filtering=True,id=a656f581-e84f-4097-b646-b62dfe641cc5,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa656f581-e8') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6bbae58-0936-5304-9861-f462c3010c8b', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa656f581-e8, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa656f581-e8, col_values=(('qos', UUID('d4f4be7a-3f09-42fb-bfb5-acf23cf075ea')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa656f581-e8, col_values=(('external_ids', {'iface-id': 'a656f581-e84f-4097-b646-b62dfe641cc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:3a:51', 'vm-uuid': 'f624d1c4-18d4-4f1f-99e9-4f18f05295ef'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:24 user nova-compute[80928]: INFO os_vif [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3a:51,bridge_name='br-int',has_traffic_filtering=True,id=a656f581-e84f-4097-b646-b62dfe641cc5,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa656f581-e8')
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] No VIF found with MAC fa:16:3e:a1:3a:51, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Updating instance_info_cache with network_info: [{"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:58:24 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:58:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-bbfb9621-b22d-45a7-bf44-5f785a355db5 req-59796db4-362d-4128-ba88-58716089783e service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Received event network-vif-plugged-a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bbfb9621-b22d-45a7-bf44-5f785a355db5 req-59796db4-362d-4128-ba88-58716089783e service nova] Acquiring lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bbfb9621-b22d-45a7-bf44-5f785a355db5 req-59796db4-362d-4128-ba88-58716089783e service nova] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bbfb9621-b22d-45a7-bf44-5f785a355db5 req-59796db4-362d-4128-ba88-58716089783e service nova] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-bbfb9621-b22d-45a7-bf44-5f785a355db5 req-59796db4-362d-4128-ba88-58716089783e service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] No waiting events found dispatching network-vif-plugged-a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:58:25 user nova-compute[80928]: WARNING nova.compute.manager [req-bbfb9621-b22d-45a7-bf44-5f785a355db5 req-59796db4-362d-4128-ba88-58716089783e service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Received unexpected event network-vif-plugged-a656f581-e84f-4097-b646-b62dfe641cc5 for instance with vm_state building and task_state spawning.
Nov 16 05:58:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:58:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:58:27 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Instance spawned successfully.
Nov 16 05:58:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:58:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:58:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:58:27 user nova-compute[80928]: INFO nova.compute.manager [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 16 05:58:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:58:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-eddef3d2-13cf-4dae-add3-ef01ce1d8da4 req-b2e95e66-5b10-45d6-bd01-3c7c365cd9ab service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Received event network-vif-plugged-a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-eddef3d2-13cf-4dae-add3-ef01ce1d8da4 req-b2e95e66-5b10-45d6-bd01-3c7c365cd9ab service nova] Acquiring lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-eddef3d2-13cf-4dae-add3-ef01ce1d8da4 req-b2e95e66-5b10-45d6-bd01-3c7c365cd9ab service nova] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-eddef3d2-13cf-4dae-add3-ef01ce1d8da4 req-b2e95e66-5b10-45d6-bd01-3c7c365cd9ab service nova] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-eddef3d2-13cf-4dae-add3-ef01ce1d8da4 req-b2e95e66-5b10-45d6-bd01-3c7c365cd9ab service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] No waiting events found dispatching network-vif-plugged-a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:58:27 user nova-compute[80928]: WARNING nova.compute.manager [req-eddef3d2-13cf-4dae-add3-ef01ce1d8da4 req-b2e95e66-5b10-45d6-bd01-3c7c365cd9ab service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Received unexpected event network-vif-plugged-a656f581-e84f-4097-b646-b62dfe641cc5 for instance with vm_state building and task_state spawning.
Nov 16 05:58:27 user nova-compute[80928]: INFO nova.compute.manager [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Took 16.34 seconds to build instance.
Nov 16 05:58:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-55e519c9-2e4c-4553-86f8-2cb08fe12aec tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.434s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:27 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:58:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjsguCIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 05:58:28 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:58:28 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 05:58:28 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4172ed17-a72d-4b18-b648-af9688c042b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 05:58:28 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c9d879-0f90-402d-ab21-d908f8304f18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe] added
Nov 16 05:58:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a08f66-8056-4db2-b6f1-19760af1de12]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe2b285-d2bf-440c-9cbc-12b16905a4fc]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjsguCIY {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjsguCIY" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c30300-8ffc-4d53-b0c2-ddc31835f5d0]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WjsguCIY'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3511ace9-fbd0-4888-9c37-d7c5267bd795]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dc6582-cbcb-4957-b7cc-e8225c3fefdd]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 05:58:28 user nova-compute[80928]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 (non-flash)
Nov 16 05:58:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 05:58:28 user nova-compute[80928]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 (non-flash)
Nov 16 05:58:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d095438b-7e29-48c8-a924-7317cfd9b2eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe, portal: 172.16.0.220,3260]
Nov 16 05:58:28 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe, portal: 172.16.0.220,3260] successful.
Nov 16 05:58:28 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bbc0d1-1d1e-4446-a6a8-d7bb0ec87793]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 05:58:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9766502-0a55-4ca6-aa5a-518f0bb7f7e9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 05:58:29 user nova-compute[80928]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 (non-flash)
Nov 16 05:58:29 user nova-compute[80928]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe (non-flash)
Nov 16 05:58:29 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 05:58:29 user nova-compute[80928]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 (non-flash)
Nov 16 05:58:29 user nova-compute[80928]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe (non-flash)
Nov 16 05:58:29 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c55bd6c-36bd-4bd4-b116-b21f8bacfc5e]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjsguCIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 05:58:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 05:58:30 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23833643365356638', 'path': '/dev/sdd'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 05:58:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833643365356638', 'path': '/dev/sdd'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 05:58:30 user nova-compute[80928]: DEBUG nova.objects.instance [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'flavor' on Instance uuid 2bf7b0af-49ef-4cda-92e7-cb1834ba739f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:58:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 05:58:30 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 05:58:30 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 05:58:30 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 05:58:30 user nova-compute[80928]:   <serial>955878dc-c623-4dc9-a090-fd7273b34afe</serial>
Nov 16 05:58:30 user nova-compute[80928]: </disk>
Nov 16 05:58:30 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 05:58:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:58:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:58:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] No VIF found with MAC fa:16:3e:82:41:d1, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:58:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-59cbdb02-91d5-43f7-bbe2-43263611c339 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.830s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-e121a595-85e9-46e0-becc-461b2c19dbf5 req-3e47bde3-509d-4396-b1da-c685d7e7ee73 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-changed-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-e121a595-85e9-46e0-becc-461b2c19dbf5 req-3e47bde3-509d-4396-b1da-c685d7e7ee73 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Refreshing instance network info cache due to event network-changed-de3fe3b7-fb26-4218-9188-f50986f7b7f0. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:58:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e121a595-85e9-46e0-becc-461b2c19dbf5 req-3e47bde3-509d-4396-b1da-c685d7e7ee73 service nova] Acquiring lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:58:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e121a595-85e9-46e0-becc-461b2c19dbf5 req-3e47bde3-509d-4396-b1da-c685d7e7ee73 service nova] Acquired lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:58:34 user nova-compute[80928]: DEBUG nova.network.neutron [req-e121a595-85e9-46e0-becc-461b2c19dbf5 req-3e47bde3-509d-4396-b1da-c685d7e7ee73 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Refreshing network info cache for port de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:58:34 user nova-compute[80928]: DEBUG nova.network.neutron [req-e121a595-85e9-46e0-becc-461b2c19dbf5 req-3e47bde3-509d-4396-b1da-c685d7e7ee73 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updated VIF entry in instance network info cache for port de3fe3b7-fb26-4218-9188-f50986f7b7f0. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:58:34 user nova-compute[80928]: DEBUG nova.network.neutron [req-e121a595-85e9-46e0-becc-461b2c19dbf5 req-3e47bde3-509d-4396-b1da-c685d7e7ee73 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updating instance_info_cache with network_info: [{"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:58:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e121a595-85e9-46e0-becc-461b2c19dbf5 req-3e47bde3-509d-4396-b1da-c685d7e7ee73 service nova] Releasing lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:58:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:36 user nova-compute[80928]: DEBUG nova.compute.manager [req-beda97d1-6434-494d-8b73-dff9b5649df9 req-0c8f6ddd-8d12-44a6-8f1f-f6071d530e2e service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-changed-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:36 user nova-compute[80928]: DEBUG nova.compute.manager [req-beda97d1-6434-494d-8b73-dff9b5649df9 req-0c8f6ddd-8d12-44a6-8f1f-f6071d530e2e service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Refreshing instance network info cache due to event network-changed-de3fe3b7-fb26-4218-9188-f50986f7b7f0. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:58:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-beda97d1-6434-494d-8b73-dff9b5649df9 req-0c8f6ddd-8d12-44a6-8f1f-f6071d530e2e service nova] Acquiring lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:58:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-beda97d1-6434-494d-8b73-dff9b5649df9 req-0c8f6ddd-8d12-44a6-8f1f-f6071d530e2e service nova] Acquired lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:58:36 user nova-compute[80928]: DEBUG nova.network.neutron [req-beda97d1-6434-494d-8b73-dff9b5649df9 req-0c8f6ddd-8d12-44a6-8f1f-f6071d530e2e service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Refreshing network info cache for port de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:58:37 user nova-compute[80928]: DEBUG nova.network.neutron [req-beda97d1-6434-494d-8b73-dff9b5649df9 req-0c8f6ddd-8d12-44a6-8f1f-f6071d530e2e service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updated VIF entry in instance network info cache for port de3fe3b7-fb26-4218-9188-f50986f7b7f0. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:58:37 user nova-compute[80928]: DEBUG nova.network.neutron [req-beda97d1-6434-494d-8b73-dff9b5649df9 req-0c8f6ddd-8d12-44a6-8f1f-f6071d530e2e service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updating instance_info_cache with network_info: [{"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:58:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-beda97d1-6434-494d-8b73-dff9b5649df9 req-0c8f6ddd-8d12-44a6-8f1f-f6071d530e2e service nova] Releasing lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:58:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:37 user nova-compute[80928]: INFO nova.compute.manager [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Rebooting instance
Nov 16 05:58:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:58:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquired lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:58:37 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:58:37 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updating instance_info_cache with network_info: [{"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:58:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Releasing lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:58:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:58:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-2278d5cb-1a31-45ef-8270-ec6c9c9564b4 req-8f3954fc-5d80-4b2e-b529-7a438a109b55 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-unplugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2278d5cb-1a31-45ef-8270-ec6c9c9564b4 req-8f3954fc-5d80-4b2e-b529-7a438a109b55 service nova] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2278d5cb-1a31-45ef-8270-ec6c9c9564b4 req-8f3954fc-5d80-4b2e-b529-7a438a109b55 service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2278d5cb-1a31-45ef-8270-ec6c9c9564b4 req-8f3954fc-5d80-4b2e-b529-7a438a109b55 service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-2278d5cb-1a31-45ef-8270-ec6c9c9564b4 req-8f3954fc-5d80-4b2e-b529-7a438a109b55 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] No waiting events found dispatching network-vif-unplugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:58:40 user nova-compute[80928]: WARNING nova.compute.manager [req-2278d5cb-1a31-45ef-8270-ec6c9c9564b4 req-8f3954fc-5d80-4b2e-b529-7a438a109b55 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received unexpected event network-vif-unplugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 for instance with vm_state active and task_state reboot_started.
Nov 16 05:58:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Instance shutdown successfully.
Nov 16 05:58:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-291d8014-6f0e-46cd-9523-efe5c0e3a630 req-82fff6db-ae2f-4683-99b5-07c53674f58e service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-291d8014-6f0e-46cd-9523-efe5c0e3a630 req-82fff6db-ae2f-4683-99b5-07c53674f58e service nova] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-291d8014-6f0e-46cd-9523-efe5c0e3a630 req-82fff6db-ae2f-4683-99b5-07c53674f58e service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-291d8014-6f0e-46cd-9523-efe5c0e3a630 req-82fff6db-ae2f-4683-99b5-07c53674f58e service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-291d8014-6f0e-46cd-9523-efe5c0e3a630 req-82fff6db-ae2f-4683-99b5-07c53674f58e service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] No waiting events found dispatching network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:58:42 user nova-compute[80928]: WARNING nova.compute.manager [req-291d8014-6f0e-46cd-9523-efe5c0e3a630 req-82fff6db-ae2f-4683-99b5-07c53674f58e service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received unexpected event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 for instance with vm_state active and task_state reboot_started.
Nov 16 05:58:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:44 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Instance running successfully.
Nov 16 05:58:44 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Instance soft rebooted successfully.
Nov 16 05:58:44 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:58:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e8269e2a-ff60-425d-8908-2f02de87f332 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.132s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-ee289b1a-a14c-491b-b1bd-fd73c2a29580 req-970dc507-6bd2-4c40-a0fe-99b31b399131 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ee289b1a-a14c-491b-b1bd-fd73c2a29580 req-970dc507-6bd2-4c40-a0fe-99b31b399131 service nova] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ee289b1a-a14c-491b-b1bd-fd73c2a29580 req-970dc507-6bd2-4c40-a0fe-99b31b399131 service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ee289b1a-a14c-491b-b1bd-fd73c2a29580 req-970dc507-6bd2-4c40-a0fe-99b31b399131 service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-ee289b1a-a14c-491b-b1bd-fd73c2a29580 req-970dc507-6bd2-4c40-a0fe-99b31b399131 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] No waiting events found dispatching network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:58:44 user nova-compute[80928]: WARNING nova.compute.manager [req-ee289b1a-a14c-491b-b1bd-fd73c2a29580 req-970dc507-6bd2-4c40-a0fe-99b31b399131 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received unexpected event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 for instance with vm_state active and task_state None.
Nov 16 05:58:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-ee289b1a-a14c-491b-b1bd-fd73c2a29580 req-970dc507-6bd2-4c40-a0fe-99b31b399131 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ee289b1a-a14c-491b-b1bd-fd73c2a29580 req-970dc507-6bd2-4c40-a0fe-99b31b399131 service nova] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ee289b1a-a14c-491b-b1bd-fd73c2a29580 req-970dc507-6bd2-4c40-a0fe-99b31b399131 service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ee289b1a-a14c-491b-b1bd-fd73c2a29580 req-970dc507-6bd2-4c40-a0fe-99b31b399131 service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-ee289b1a-a14c-491b-b1bd-fd73c2a29580 req-970dc507-6bd2-4c40-a0fe-99b31b399131 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] No waiting events found dispatching network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:58:44 user nova-compute[80928]: WARNING nova.compute.manager [req-ee289b1a-a14c-491b-b1bd-fd73c2a29580 req-970dc507-6bd2-4c40-a0fe-99b31b399131 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received unexpected event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 for instance with vm_state active and task_state None.
Nov 16 05:58:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:49 user nova-compute[80928]: INFO nova.compute.manager [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Terminating instance
Nov 16 05:58:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 05:58:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Instance destroyed successfully.
Nov 16 05:58:50 user nova-compute[80928]: DEBUG nova.objects.instance [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'resources' on Instance uuid 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1608335381',display_name='tempest-AttachVolumeTestJSON-server-1608335381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1608335381',id=38,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIheiaIxPwP6SA4L1FNfT/iVP2oIcKbZWevRs6N7x4qvsfqzxVVfO6fF8zGk5rw0ndDEv99BxFLQjD1+Tt+oqfeijNH8TrsvSWOfBX1YC4BXEZkch1QPW+6pCo5Kkt1+w==',key_name='tempest-keypair-845255928',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05d6e74da88a497ca920dcb2e07ea05a',ramdisk_id='',reservation_id='r-yk964sbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1530907565',owner_user_name='tempest-AttachVolumeTestJSON-1530907565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:57:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be30aca2412b475498f99dddb86c5983',uuid=35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converting VIF {"id": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "address": "fa:16:3e:86:53:a9", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453ccbb-c8", "ovs_interfaceid": "7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG os_vif [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7453ccbb-c8, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-d39b4ca2-fbfd-45e0-a50c-483ef036b61c req-ac77aaa1-94f2-4971-985c-5e12757f6d24 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-unplugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d39b4ca2-fbfd-45e0-a50c-483ef036b61c req-ac77aaa1-94f2-4971-985c-5e12757f6d24 service nova] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d39b4ca2-fbfd-45e0-a50c-483ef036b61c req-ac77aaa1-94f2-4971-985c-5e12757f6d24 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d39b4ca2-fbfd-45e0-a50c-483ef036b61c req-ac77aaa1-94f2-4971-985c-5e12757f6d24 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-d39b4ca2-fbfd-45e0-a50c-483ef036b61c req-ac77aaa1-94f2-4971-985c-5e12757f6d24 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] No waiting events found dispatching network-vif-unplugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-d39b4ca2-fbfd-45e0-a50c-483ef036b61c req-ac77aaa1-94f2-4971-985c-5e12757f6d24 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-unplugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15ea9554-d550-4a62-8f4c-b720176c05bb) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:58:50 user nova-compute[80928]: INFO os_vif [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:53:a9,bridge_name='br-int',has_traffic_filtering=True,id=7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453ccbb-c8')
Nov 16 05:58:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Deleting instance files /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7_del
Nov 16 05:58:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Deletion of /opt/stack/data/nova/instances/35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7_del complete
Nov 16 05:58:50 user nova-compute[80928]: INFO nova.compute.manager [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 05:58:50 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 05:58:50 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 05:58:51 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:58:51 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Took 0.70 seconds to deallocate network for instance.
Nov 16 05:58:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:51 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:58:51 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:58:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:51 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Deleted allocations for instance 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7
Nov 16 05:58:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b35a5165-cda0-49ae-bb72-51c5ba725cb5 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.985s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-eaed3b99-a66f-4fbb-9e45-3c3f3c3df7ab req-3e00b118-39e4-46bb-ba2d-d6334b645ec8 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-eaed3b99-a66f-4fbb-9e45-3c3f3c3df7ab req-3e00b118-39e4-46bb-ba2d-d6334b645ec8 service nova] Acquiring lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:58:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-eaed3b99-a66f-4fbb-9e45-3c3f3c3df7ab req-3e00b118-39e4-46bb-ba2d-d6334b645ec8 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:58:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-eaed3b99-a66f-4fbb-9e45-3c3f3c3df7ab req-3e00b118-39e4-46bb-ba2d-d6334b645ec8 service nova] Lock "35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:58:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-eaed3b99-a66f-4fbb-9e45-3c3f3c3df7ab req-3e00b118-39e4-46bb-ba2d-d6334b645ec8 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] No waiting events found dispatching network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:58:52 user nova-compute[80928]: WARNING nova.compute.manager [req-eaed3b99-a66f-4fbb-9e45-3c3f3c3df7ab req-3e00b118-39e4-46bb-ba2d-d6334b645ec8 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received unexpected event network-vif-plugged-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 for instance with vm_state deleted and task_state None.
Nov 16 05:58:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-eaed3b99-a66f-4fbb-9e45-3c3f3c3df7ab req-3e00b118-39e4-46bb-ba2d-d6334b645ec8 service nova] [instance: 35c0fbc6-0f4d-47bb-b665-5a0c0d7e65e7] Received event network-vif-deleted-7453ccbb-c8b5-4d2c-aa7a-dc5022015ff5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:58:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:58:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:09 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:59:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:59:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:17 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:59:17 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:59:17 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:59:18 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:59:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:59:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:59:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:59:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:59:22 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 05:59:22 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 05:59:23 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:59:23 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:59:23 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8684MB free_disk=25.241641998291016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5dc200e9-4a4e-47cd-be4a-905c2f34186e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2bf7b0af-49ef-4cda-92e7-cb1834ba739f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance f624d1c4-18d4-4f1f-99e9-4f18f05295ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 05:59:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:59:24 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:59:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 05:59:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:59:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:59:25 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 05:59:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:59:25 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updating instance_info_cache with network_info: [{"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:59:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:59:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 05:59:25 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:59:27 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 05:59:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 05:59:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG nova.compute.manager [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 05:59:43 user nova-compute[80928]: INFO nova.compute.claims [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Claim successful on node user
Nov 16 05:59:43 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG nova.compute.manager [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG nova.compute.manager [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG nova.network.neutron [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 05:59:43 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 05:59:43 user nova-compute[80928]: DEBUG nova.compute.manager [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG nova.policy [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be30aca2412b475498f99dddb86c5983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d6e74da88a497ca920dcb2e07ea05a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG nova.compute.manager [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 05:59:43 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Creating image(s)
Nov 16 05:59:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "/opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "/opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "/opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:59:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk 1073741824" returned: 0 in 0.057s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.187s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG nova.network.neutron [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Successfully created port: fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Cannot resize image /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Ensure instance console log exists: /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:59:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.network.neutron [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Successfully updated port: fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquired lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.network.neutron [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.compute.manager [req-f9f955a1-6901-41b9-85e6-7891ab15921f req-858b2811-00c2-4646-8206-d6799d58df0d service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Received event network-changed-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.compute.manager [req-f9f955a1-6901-41b9-85e6-7891ab15921f req-858b2811-00c2-4646-8206-d6799d58df0d service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Refreshing instance network info cache due to event network-changed-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f9f955a1-6901-41b9-85e6-7891ab15921f req-858b2811-00c2-4646-8206-d6799d58df0d service nova] Acquiring lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.network.neutron [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.network.neutron [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updating instance_info_cache with network_info: [{"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Releasing lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.compute.manager [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Instance network_info: |[{"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f9f955a1-6901-41b9-85e6-7891ab15921f req-858b2811-00c2-4646-8206-d6799d58df0d service nova] Acquired lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.network.neutron [req-f9f955a1-6901-41b9-85e6-7891ab15921f req-858b2811-00c2-4646-8206-d6799d58df0d service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Refreshing network info cache for port fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Start _get_guest_xml network_info=[{"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 05:59:45 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:59:45 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-395964282',display_name='tempest-AttachVolumeTestJSON-server-395964282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-395964282',id=44,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN860YL751Jk7JP/cjwZ0RDF54jX6kDLrT9RGztCuEdjY1f+M1ORC0iw3iqhcAoyfMYiO2f8TSa0MIEM0x34dGI/LgfiPQaHm4CN2VTwOTiatfHFzxElHkkhB5SzKH0Ixw==',key_name='tempest-keypair-1255951038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05d6e74da88a497ca920dcb2e07ea05a',ramdisk_id='',reservation_id='r-80bk2k0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1530907565',owner_user_name='tempest-AttachVolumeTestJSON-1530907565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be30aca2412b475498f99dddb86c5983',uuid=49340b1b-d59b-47b0-8370-2bc1e37df30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converting VIF {"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:57:56,bridge_name='br-int',has_traffic_filtering=True,id=fac97c08-1ee4-4c0b-a6ab-fd8060d8660c,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac97c08-1e') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.objects.instance [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'pci_devices' on Instance uuid 49340b1b-d59b-47b0-8370-2bc1e37df30f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 05:59:45 user nova-compute[80928]:   <uuid>49340b1b-d59b-47b0-8370-2bc1e37df30f</uuid>
Nov 16 05:59:45 user nova-compute[80928]:   <name>instance-0000002c</name>
Nov 16 05:59:45 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 05:59:45 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 05:59:45 user nova-compute[80928]:   <metadata>
Nov 16 05:59:45 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 05:59:45 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 05:59:45 user nova-compute[80928]:       <nova:name>tempest-AttachVolumeTestJSON-server-395964282</nova:name>
Nov 16 05:59:45 user nova-compute[80928]:       <nova:creationTime>2023-11-16 05:59:45</nova:creationTime>
Nov 16 05:59:45 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 05:59:45 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 05:59:45 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 05:59:45 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 05:59:45 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 05:59:45 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 05:59:45 user nova-compute[80928]:       </nova:flavor>
Nov 16 05:59:45 user nova-compute[80928]:       <nova:owner>
Nov 16 05:59:45 user nova-compute[80928]:         <nova:user uuid="be30aca2412b475498f99dddb86c5983">tempest-AttachVolumeTestJSON-1530907565-project-member</nova:user>
Nov 16 05:59:45 user nova-compute[80928]:         <nova:project uuid="05d6e74da88a497ca920dcb2e07ea05a">tempest-AttachVolumeTestJSON-1530907565</nova:project>
Nov 16 05:59:45 user nova-compute[80928]:       </nova:owner>
Nov 16 05:59:45 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 05:59:45 user nova-compute[80928]:       <nova:ports>
Nov 16 05:59:45 user nova-compute[80928]:         <nova:port uuid="fac97c08-1ee4-4c0b-a6ab-fd8060d8660c">
Nov 16 05:59:45 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 05:59:45 user nova-compute[80928]:         </nova:port>
Nov 16 05:59:45 user nova-compute[80928]:       </nova:ports>
Nov 16 05:59:45 user nova-compute[80928]:     </nova:instance>
Nov 16 05:59:45 user nova-compute[80928]:   </metadata>
Nov 16 05:59:45 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 05:59:45 user nova-compute[80928]:     <system>
Nov 16 05:59:45 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 05:59:45 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 05:59:45 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 05:59:45 user nova-compute[80928]:       <entry name="serial">49340b1b-d59b-47b0-8370-2bc1e37df30f</entry>
Nov 16 05:59:45 user nova-compute[80928]:       <entry name="uuid">49340b1b-d59b-47b0-8370-2bc1e37df30f</entry>
Nov 16 05:59:45 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 05:59:45 user nova-compute[80928]:     </system>
Nov 16 05:59:45 user nova-compute[80928]:   </sysinfo>
Nov 16 05:59:45 user nova-compute[80928]:   <os>
Nov 16 05:59:45 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 05:59:45 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 05:59:45 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 05:59:45 user nova-compute[80928]:   </os>
Nov 16 05:59:45 user nova-compute[80928]:   <features>
Nov 16 05:59:45 user nova-compute[80928]:     <acpi/>
Nov 16 05:59:45 user nova-compute[80928]:     <apic/>
Nov 16 05:59:45 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 05:59:45 user nova-compute[80928]:   </features>
Nov 16 05:59:45 user nova-compute[80928]:   <clock offset="utc">
Nov 16 05:59:45 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 05:59:45 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 05:59:45 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 05:59:45 user nova-compute[80928]:   </clock>
Nov 16 05:59:45 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 05:59:45 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 05:59:45 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 05:59:45 user nova-compute[80928]:   </cpu>
Nov 16 05:59:45 user nova-compute[80928]:   <devices>
Nov 16 05:59:45 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 05:59:45 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 05:59:45 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk"/>
Nov 16 05:59:45 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 05:59:45 user nova-compute[80928]:     </disk>
Nov 16 05:59:45 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 05:59:45 user nova-compute[80928]:       <mac address="fa:16:3e:15:57:56"/>
Nov 16 05:59:45 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:59:45 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 05:59:45 user nova-compute[80928]:       <target dev="tapfac97c08-1e"/>
Nov 16 05:59:45 user nova-compute[80928]:     </interface>
Nov 16 05:59:45 user nova-compute[80928]:     <serial type="pty">
Nov 16 05:59:45 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/console.log" append="off"/>
Nov 16 05:59:45 user nova-compute[80928]:     </serial>
Nov 16 05:59:45 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 05:59:45 user nova-compute[80928]:     <video>
Nov 16 05:59:45 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 05:59:45 user nova-compute[80928]:     </video>
Nov 16 05:59:45 user nova-compute[80928]:     <rng model="virtio">
Nov 16 05:59:45 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 05:59:45 user nova-compute[80928]:     </rng>
Nov 16 05:59:45 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 05:59:45 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 05:59:45 user nova-compute[80928]:       <stats period="10"/>
Nov 16 05:59:45 user nova-compute[80928]:     </memballoon>
Nov 16 05:59:45 user nova-compute[80928]:   </devices>
Nov 16 05:59:45 user nova-compute[80928]: </domain>
Nov 16 05:59:45 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-395964282',display_name='tempest-AttachVolumeTestJSON-server-395964282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-395964282',id=44,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN860YL751Jk7JP/cjwZ0RDF54jX6kDLrT9RGztCuEdjY1f+M1ORC0iw3iqhcAoyfMYiO2f8TSa0MIEM0x34dGI/LgfiPQaHm4CN2VTwOTiatfHFzxElHkkhB5SzKH0Ixw==',key_name='tempest-keypair-1255951038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05d6e74da88a497ca920dcb2e07ea05a',ramdisk_id='',reservation_id='r-80bk2k0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1530907565',owner_user_name='tempest-AttachVolumeTestJSON-1530907565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T05:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be30aca2412b475498f99dddb86c5983',uuid=49340b1b-d59b-47b0-8370-2bc1e37df30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converting VIF {"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:57:56,bridge_name='br-int',has_traffic_filtering=True,id=fac97c08-1ee4-4c0b-a6ab-fd8060d8660c,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac97c08-1e') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG os_vif [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:57:56,bridge_name='br-int',has_traffic_filtering=True,id=fac97c08-1ee4-4c0b-a6ab-fd8060d8660c,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac97c08-1e') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '198340f1-3dd9-5c6c-bb98-eb41e784c8cf', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfac97c08-1e, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfac97c08-1e, col_values=(('qos', UUID('40a655c2-2fd2-452a-8c84-523a4ea82356')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfac97c08-1e, col_values=(('external_ids', {'iface-id': 'fac97c08-1ee4-4c0b-a6ab-fd8060d8660c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:57:56', 'vm-uuid': '49340b1b-d59b-47b0-8370-2bc1e37df30f'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:45 user nova-compute[80928]: INFO os_vif [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:57:56,bridge_name='br-int',has_traffic_filtering=True,id=fac97c08-1ee4-4c0b-a6ab-fd8060d8660c,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac97c08-1e')
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No VIF found with MAC fa:16:3e:15:57:56, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.network.neutron [req-f9f955a1-6901-41b9-85e6-7891ab15921f req-858b2811-00c2-4646-8206-d6799d58df0d service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updated VIF entry in instance network info cache for port fac97c08-1ee4-4c0b-a6ab-fd8060d8660c. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG nova.network.neutron [req-f9f955a1-6901-41b9-85e6-7891ab15921f req-858b2811-00c2-4646-8206-d6799d58df0d service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updating instance_info_cache with network_info: [{"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 05:59:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f9f955a1-6901-41b9-85e6-7891ab15921f req-858b2811-00c2-4646-8206-d6799d58df0d service nova] Releasing lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 05:59:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-cecbeafc-16c7-40a9-9e9c-482bdf8c2da1 req-4cbf6418-8b00-4228-a89e-c19ada5d91bd service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Received event network-vif-plugged-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:59:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cecbeafc-16c7-40a9-9e9c-482bdf8c2da1 req-4cbf6418-8b00-4228-a89e-c19ada5d91bd service nova] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:59:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cecbeafc-16c7-40a9-9e9c-482bdf8c2da1 req-4cbf6418-8b00-4228-a89e-c19ada5d91bd service nova] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:59:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cecbeafc-16c7-40a9-9e9c-482bdf8c2da1 req-4cbf6418-8b00-4228-a89e-c19ada5d91bd service nova] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:59:47 user nova-compute[80928]: DEBUG nova.compute.manager [req-cecbeafc-16c7-40a9-9e9c-482bdf8c2da1 req-4cbf6418-8b00-4228-a89e-c19ada5d91bd service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] No waiting events found dispatching network-vif-plugged-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:59:47 user nova-compute[80928]: WARNING nova.compute.manager [req-cecbeafc-16c7-40a9-9e9c-482bdf8c2da1 req-4cbf6418-8b00-4228-a89e-c19ada5d91bd service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Received unexpected event network-vif-plugged-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c for instance with vm_state building and task_state spawning.
Nov 16 05:59:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 05:59:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 05:59:48 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Instance spawned successfully.
Nov 16 05:59:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 05:59:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:59:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:59:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:59:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:59:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:59:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 05:59:49 user nova-compute[80928]: INFO nova.compute.manager [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 16 05:59:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 05:59:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-b01b252e-307a-45de-adf3-ae8ae3e63f61 req-0b3ee63d-4965-46d7-b1ff-cb2e29137f02 service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Received event network-vif-plugged-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 05:59:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b01b252e-307a-45de-adf3-ae8ae3e63f61 req-0b3ee63d-4965-46d7-b1ff-cb2e29137f02 service nova] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 05:59:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b01b252e-307a-45de-adf3-ae8ae3e63f61 req-0b3ee63d-4965-46d7-b1ff-cb2e29137f02 service nova] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 05:59:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b01b252e-307a-45de-adf3-ae8ae3e63f61 req-0b3ee63d-4965-46d7-b1ff-cb2e29137f02 service nova] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:59:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-b01b252e-307a-45de-adf3-ae8ae3e63f61 req-0b3ee63d-4965-46d7-b1ff-cb2e29137f02 service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] No waiting events found dispatching network-vif-plugged-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 05:59:49 user nova-compute[80928]: WARNING nova.compute.manager [req-b01b252e-307a-45de-adf3-ae8ae3e63f61 req-0b3ee63d-4965-46d7-b1ff-cb2e29137f02 service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Received unexpected event network-vif-plugged-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c for instance with vm_state building and task_state spawning.
Nov 16 05:59:49 user nova-compute[80928]: INFO nova.compute.manager [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Took 5.81 seconds to build instance.
Nov 16 05:59:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-44dba15d-9c14-4133-9976-efc45eee47c2 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.901s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 05:59:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 05:59:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:00:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:00:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:00:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:00:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-5d0df693-b863-4aeb-b75e-73726e1c75e1 req-35e1acb6-096f-4883-aa1f-9ebb8b34f985 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Received event network-changed-a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG nova.compute.manager [req-5d0df693-b863-4aeb-b75e-73726e1c75e1 req-35e1acb6-096f-4883-aa1f-9ebb8b34f985 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Refreshing instance network info cache due to event network-changed-a656f581-e84f-4097-b646-b62dfe641cc5. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5d0df693-b863-4aeb-b75e-73726e1c75e1 req-35e1acb6-096f-4883-aa1f-9ebb8b34f985 service nova] Acquiring lock "refresh_cache-f624d1c4-18d4-4f1f-99e9-4f18f05295ef" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5d0df693-b863-4aeb-b75e-73726e1c75e1 req-35e1acb6-096f-4883-aa1f-9ebb8b34f985 service nova] Acquired lock "refresh_cache-f624d1c4-18d4-4f1f-99e9-4f18f05295ef" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG nova.network.neutron [req-5d0df693-b863-4aeb-b75e-73726e1c75e1 req-35e1acb6-096f-4883-aa1f-9ebb8b34f985 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Refreshing network info cache for port a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG nova.network.neutron [req-5d0df693-b863-4aeb-b75e-73726e1c75e1 req-35e1acb6-096f-4883-aa1f-9ebb8b34f985 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Updated VIF entry in instance network info cache for port a656f581-e84f-4097-b646-b62dfe641cc5. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG nova.network.neutron [req-5d0df693-b863-4aeb-b75e-73726e1c75e1 req-35e1acb6-096f-4883-aa1f-9ebb8b34f985 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Updating instance_info_cache with network_info: [{"id": "a656f581-e84f-4097-b646-b62dfe641cc5", "address": "fa:16:3e:a1:3a:51", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa656f581-e8", "ovs_interfaceid": "a656f581-e84f-4097-b646-b62dfe641cc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5d0df693-b863-4aeb-b75e-73726e1c75e1 req-35e1acb6-096f-4883-aa1f-9ebb8b34f985 service nova] Releasing lock "refresh_cache-f624d1c4-18d4-4f1f-99e9-4f18f05295ef" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:02 user nova-compute[80928]: INFO nova.compute.manager [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Terminating instance
Nov 16 06:00:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:03 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Instance destroyed successfully.
Nov 16 06:00:03 user nova-compute[80928]: DEBUG nova.objects.instance [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lazy-loading 'resources' on Instance uuid f624d1c4-18d4-4f1f-99e9-4f18f05295ef {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-450726560',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-450726560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-450726560',id=43,image_ref='b7d650d5-dd80-4fd9-81ce-2c3538839207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKIDGw7lOd9v5fgfeaXUinGd/FsnNu9fFW7Hv6Y3eJ0m6De+YePibxHvJdPWjm3ouLQnxdued3mk5xI/udB/MinzlvREoLuvaqsSVCc1q/KTjEgypx0+B4lGHxqXMUCFg==',key_name='tempest-keypair-990253658',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:58:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-f7665blw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-315833619',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:58:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=f624d1c4-18d4-4f1f-99e9-4f18f05295ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a656f581-e84f-4097-b646-b62dfe641cc5", "address": "fa:16:3e:a1:3a:51", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa656f581-e8", "ovs_interfaceid": "a656f581-e84f-4097-b646-b62dfe641cc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "a656f581-e84f-4097-b646-b62dfe641cc5", "address": "fa:16:3e:a1:3a:51", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa656f581-e8", "ovs_interfaceid": "a656f581-e84f-4097-b646-b62dfe641cc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3a:51,bridge_name='br-int',has_traffic_filtering=True,id=a656f581-e84f-4097-b646-b62dfe641cc5,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa656f581-e8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_vif [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3a:51,bridge_name='br-int',has_traffic_filtering=True,id=a656f581-e84f-4097-b646-b62dfe641cc5,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa656f581-e8') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa656f581-e8, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4f4be7a-3f09-42fb-bfb5-acf23cf075ea) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:00:03 user nova-compute[80928]: INFO os_vif [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3a:51,bridge_name='br-int',has_traffic_filtering=True,id=a656f581-e84f-4097-b646-b62dfe641cc5,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa656f581-e8')
Nov 16 06:00:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGanZQBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:00:03 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e58f88b-7197-401e-bf17-4912f5c6367e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:00:03 user nova-compute[80928]: No targets found.
Nov 16 06:00:03 user nova-compute[80928]: iSNS:
Nov 16 06:00:03 user nova-compute[80928]: No targets found.
Nov 16 06:00:03 user nova-compute[80928]: STATIC:
Nov 16 06:00:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3
Nov 16 06:00:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:00:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:00:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe
Nov 16 06:00:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:00:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:00:03 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814
Nov 16 06:00:03 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:00:03 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:00:03 user nova-compute[80928]: FIRMWARE:
Nov 16 06:00:03 user nova-compute[80928]: No targets found.
Nov 16 06:00:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:00:03 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:00:03 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f54895-0463-4006-8dd7-2de5f7c62be7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[54922263-8f8a-43cd-be62-5510abe54975]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 06:00:03 user nova-compute[80928]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 (non-flash)
Nov 16 06:00:03 user nova-compute[80928]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe (non-flash)
Nov 16 06:00:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 06:00:03 user nova-compute[80928]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 (non-flash)
Nov 16 06:00:03 user nova-compute[80928]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe (non-flash)
Nov 16 06:00:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8658360280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a496ffa6-1308-4abf-a02a-cbd79f13e40a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5ef3be-52e2-47f4-a396-d452e9cdddbc]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[19337f4f-72ae-4299-85a6-758f66f633df]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[952811e8-f0ce-45db-9019-0fd453f7f86b]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26661363066386337', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c815838', '/dev/disk/by-id/scsi-1SCST_BIOc815838-fa60f8c7efa0d9be') {{(pid=92262) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd954c0-7bc9-4ad9-851b-e73feb4ba68f]: (4, None) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aabb71-d7a8-49ec-b602-97ee9ec64c5c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4050e5-9ea8-47b5-b5fe-3cf22b50ee95]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3, portal: 172.16.0.220,3260]
Nov 16 06:00:03 user nova-compute[80928]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3, portal: 172.16.0.220,3260] successful.
Nov 16 06:00:03 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:00:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b24331-60c9-4693-ab0c-71f71a4737d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6945ed6a-f123-478a-8529-16ccbdc7a677]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== disconnect_volume: return (293ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:00:04 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Deleting instance files /opt/stack/data/nova/instances/f624d1c4-18d4-4f1f-99e9-4f18f05295ef_del
Nov 16 06:00:04 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Deletion of /opt/stack/data/nova/instances/f624d1c4-18d4-4f1f-99e9-4f18f05295ef_del complete
Nov 16 06:00:04 user nova-compute[80928]: INFO nova.compute.manager [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 16 06:00:04 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-8b7f4b8d-0112-417d-b5c8-ff8e2b9a9eb4 req-11cb6afc-5b31-4f5e-8422-8c7918bc27f7 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Received event network-vif-unplugged-a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b7f4b8d-0112-417d-b5c8-ff8e2b9a9eb4 req-11cb6afc-5b31-4f5e-8422-8c7918bc27f7 service nova] Acquiring lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b7f4b8d-0112-417d-b5c8-ff8e2b9a9eb4 req-11cb6afc-5b31-4f5e-8422-8c7918bc27f7 service nova] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b7f4b8d-0112-417d-b5c8-ff8e2b9a9eb4 req-11cb6afc-5b31-4f5e-8422-8c7918bc27f7 service nova] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-8b7f4b8d-0112-417d-b5c8-ff8e2b9a9eb4 req-11cb6afc-5b31-4f5e-8422-8c7918bc27f7 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] No waiting events found dispatching network-vif-unplugged-a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-8b7f4b8d-0112-417d-b5c8-ff8e2b9a9eb4 req-11cb6afc-5b31-4f5e-8422-8c7918bc27f7 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Received event network-vif-unplugged-a656f581-e84f-4097-b646-b62dfe641cc5 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-8b7f4b8d-0112-417d-b5c8-ff8e2b9a9eb4 req-11cb6afc-5b31-4f5e-8422-8c7918bc27f7 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Received event network-vif-plugged-a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b7f4b8d-0112-417d-b5c8-ff8e2b9a9eb4 req-11cb6afc-5b31-4f5e-8422-8c7918bc27f7 service nova] Acquiring lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b7f4b8d-0112-417d-b5c8-ff8e2b9a9eb4 req-11cb6afc-5b31-4f5e-8422-8c7918bc27f7 service nova] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8b7f4b8d-0112-417d-b5c8-ff8e2b9a9eb4 req-11cb6afc-5b31-4f5e-8422-8c7918bc27f7 service nova] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-8b7f4b8d-0112-417d-b5c8-ff8e2b9a9eb4 req-11cb6afc-5b31-4f5e-8422-8c7918bc27f7 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] No waiting events found dispatching network-vif-plugged-a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:00:04 user nova-compute[80928]: WARNING nova.compute.manager [req-8b7f4b8d-0112-417d-b5c8-ff8e2b9a9eb4 req-11cb6afc-5b31-4f5e-8422-8c7918bc27f7 service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Received unexpected event network-vif-plugged-a656f581-e84f-4097-b646-b62dfe641cc5 for instance with vm_state active and task_state deleting.
Nov 16 06:00:04 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:00:04 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Took 0.78 seconds to deallocate network for instance.
Nov 16 06:00:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-5d45c3d8-fbea-46e6-bef8-3feb2e896378 req-db60ac15-56a4-4f49-a29b-582bd57e12df service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Received event network-vif-deleted-a656f581-e84f-4097-b646-b62dfe641cc5 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:04 user nova-compute[80928]: INFO nova.compute.manager [req-5d45c3d8-fbea-46e6-bef8-3feb2e896378 req-db60ac15-56a4-4f49-a29b-582bd57e12df service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Neutron deleted interface a656f581-e84f-4097-b646-b62dfe641cc5; detaching it from the instance and deleting it from the info cache
Nov 16 06:00:04 user nova-compute[80928]: DEBUG nova.network.neutron [req-5d45c3d8-fbea-46e6-bef8-3feb2e896378 req-db60ac15-56a4-4f49-a29b-582bd57e12df service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:00:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-5d45c3d8-fbea-46e6-bef8-3feb2e896378 req-db60ac15-56a4-4f49-a29b-582bd57e12df service nova] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Detach interface failed, port_id=a656f581-e84f-4097-b646-b62dfe641cc5, reason: Instance f624d1c4-18d4-4f1f-99e9-4f18f05295ef could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 06:00:05 user nova-compute[80928]: INFO nova.compute.manager [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Took 0.76 seconds to detach 1 volumes for instance.
Nov 16 06:00:05 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: f624d1c4-18d4-4f1f-99e9-4f18f05295ef] Deleting volume: 14b24331-60c9-4693-ab0c-71f71a4737d3 {{(pid=80928) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 06:00:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:05 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:00:05 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:00:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:06 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Deleted allocations for instance f624d1c4-18d4-4f1f-99e9-4f18f05295ef
Nov 16 06:00:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9d657f41-0fb1-4af3-be73-f6ef625bf334 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "f624d1c4-18d4-4f1f-99e9-4f18f05295ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.139s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:09 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:00:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:00:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:18 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:00:19 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:00:19 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:00:21 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:00:21 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances with incomplete migration  {{(pid=80928) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 06:00:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:00:24 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:00:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:24 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:00:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 06:00:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 06:00:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:26 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:00:26 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8673MB free_disk=25.211490631103516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 5dc200e9-4a4e-47cd-be4a-905c2f34186e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2bf7b0af-49ef-4cda-92e7-cb1834ba739f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 49340b1b-d59b-47b0-8370-2bc1e37df30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing inventories for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating ProviderTree inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing aggregate associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, aggregates: None {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing trait associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:00:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:27 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:00:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:00:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:00:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:00:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:00:27 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:00:27 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 5dc200e9-4a4e-47cd-be4a-905c2f34186e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:00:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Updating instance_info_cache with network_info: [{"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:00:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-5dc200e9-4a4e-47cd-be4a-905c2f34186e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:00:28 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:00:28 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:00:28 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:00:28 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:00:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:00:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-c7704e8b-1ffa-404c-9595-8cfda2115699 req-cbf76568-02ed-4dc3-b849-42762f30e6fa service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-changed-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-c7704e8b-1ffa-404c-9595-8cfda2115699 req-cbf76568-02ed-4dc3-b849-42762f30e6fa service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Refreshing instance network info cache due to event network-changed-de3fe3b7-fb26-4218-9188-f50986f7b7f0. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:00:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c7704e8b-1ffa-404c-9595-8cfda2115699 req-cbf76568-02ed-4dc3-b849-42762f30e6fa service nova] Acquiring lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:00:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c7704e8b-1ffa-404c-9595-8cfda2115699 req-cbf76568-02ed-4dc3-b849-42762f30e6fa service nova] Acquired lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:00:28 user nova-compute[80928]: DEBUG nova.network.neutron [req-c7704e8b-1ffa-404c-9595-8cfda2115699 req-cbf76568-02ed-4dc3-b849-42762f30e6fa service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Refreshing network info cache for port de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:00:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-c7704e8b-1ffa-404c-9595-8cfda2115699 req-cbf76568-02ed-4dc3-b849-42762f30e6fa service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updated VIF entry in instance network info cache for port de3fe3b7-fb26-4218-9188-f50986f7b7f0. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:00:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-c7704e8b-1ffa-404c-9595-8cfda2115699 req-cbf76568-02ed-4dc3-b849-42762f30e6fa service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updating instance_info_cache with network_info: [{"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:00:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c7704e8b-1ffa-404c-9595-8cfda2115699 req-cbf76568-02ed-4dc3-b849-42762f30e6fa service nova] Releasing lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:00:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-79b723a9-9b61-4ab8-9688-c7d5d17c2b1f req-0afbb926-e6a3-4064-a68c-e5725ad7ec7d service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-changed-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-79b723a9-9b61-4ab8-9688-c7d5d17c2b1f req-0afbb926-e6a3-4064-a68c-e5725ad7ec7d service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Refreshing instance network info cache due to event network-changed-de3fe3b7-fb26-4218-9188-f50986f7b7f0. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:00:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-79b723a9-9b61-4ab8-9688-c7d5d17c2b1f req-0afbb926-e6a3-4064-a68c-e5725ad7ec7d service nova] Acquiring lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:00:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-79b723a9-9b61-4ab8-9688-c7d5d17c2b1f req-0afbb926-e6a3-4064-a68c-e5725ad7ec7d service nova] Acquired lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:00:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-79b723a9-9b61-4ab8-9688-c7d5d17c2b1f req-0afbb926-e6a3-4064-a68c-e5725ad7ec7d service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Refreshing network info cache for port de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:00:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:29 user nova-compute[80928]: INFO nova.compute.manager [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Detaching volume 955878dc-c623-4dc9-a090-fd7273b34afe
Nov 16 06:00:30 user nova-compute[80928]: INFO nova.virt.block_device [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Attempting to driver detach volume 955878dc-c623-4dc9-a090-fd7273b34afe from mountpoint /dev/vdb
Nov 16 06:00:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Attempting to detach device vdb from instance 2bf7b0af-49ef-4cda-92e7-cb1834ba739f from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 06:00:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:00:30 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:00:30 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 06:00:30 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:00:30 user nova-compute[80928]:   <serial>955878dc-c623-4dc9-a090-fd7273b34afe</serial>
Nov 16 06:00:30 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:00:30 user nova-compute[80928]: </disk>
Nov 16 06:00:30 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:00:30 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Successfully detached device vdb from instance 2bf7b0af-49ef-4cda-92e7-cb1834ba739f from the persistent domain config.
Nov 16 06:00:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2bf7b0af-49ef-4cda-92e7-cb1834ba739f from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 06:00:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:00:30 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:00:30 user nova-compute[80928]:   <source dev="/dev/sdd"/>
Nov 16 06:00:30 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:00:30 user nova-compute[80928]:   <serial>955878dc-c623-4dc9-a090-fd7273b34afe</serial>
Nov 16 06:00:30 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:00:30 user nova-compute[80928]: </disk>
Nov 16 06:00:30 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:00:30 user nova-compute[80928]: DEBUG nova.network.neutron [req-79b723a9-9b61-4ab8-9688-c7d5d17c2b1f req-0afbb926-e6a3-4064-a68c-e5725ad7ec7d service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updated VIF entry in instance network info cache for port de3fe3b7-fb26-4218-9188-f50986f7b7f0. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:00:30 user nova-compute[80928]: DEBUG nova.network.neutron [req-79b723a9-9b61-4ab8-9688-c7d5d17c2b1f req-0afbb926-e6a3-4064-a68c-e5725ad7ec7d service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updating instance_info_cache with network_info: [{"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:00:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-79b723a9-9b61-4ab8-9688-c7d5d17c2b1f req-0afbb926-e6a3-4064-a68c-e5725ad7ec7d service nova] Releasing lock "refresh_cache-2bf7b0af-49ef-4cda-92e7-cb1834ba739f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:00:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2bf7b0af-49ef-4cda-92e7-cb1834ba739f {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 06:00:30 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:00:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:00:45 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:00:45 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 06:00:45 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] There are 0 instances to clean {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 06:00:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:50 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2bf7b0af-49ef-4cda-92e7-cb1834ba739f is timed out.
Nov 16 06:00:50 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Successfully detached device vdb from instance 2bf7b0af-49ef-4cda-92e7-cb1834ba739f from the live domain config.
Nov 16 06:00:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjsguCIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:00:50 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1a7be1-4505-4ff9-8f41-a4a905d5f97d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:00:50 user nova-compute[80928]: No targets found.
Nov 16 06:00:50 user nova-compute[80928]: iSNS:
Nov 16 06:00:50 user nova-compute[80928]: No targets found.
Nov 16 06:00:50 user nova-compute[80928]: STATIC:
Nov 16 06:00:50 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe
Nov 16 06:00:50 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:00:50 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:00:50 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814
Nov 16 06:00:50 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:00:50 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:00:50 user nova-compute[80928]: FIRMWARE:
Nov 16 06:00:50 user nova-compute[80928]: No targets found.
Nov 16 06:00:50 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:00:50 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:00:50 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf53526-a5dd-4621-8a2f-9c9632a09b6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c8d008-b0fb-4729-a107-b7c26966e115]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 06:00:50 user nova-compute[80928]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe (non-flash)
Nov 16 06:00:50 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 06:00:50 user nova-compute[80928]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe (non-flash)
Nov 16 06:00:50 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe'): ({'sdd'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Removing single pathed devices sdd {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[92041ef8-6abe-48ce-aae1-06f671155198]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e3cdb5-b7b8-4730-ad64-002e78b89d35]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Flushing IO for device /dev/sdd {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c057aec4-2d5c-4029-8646-eb9d78557d3b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b0a7df-5551-4570-8a64-1783bb52f5d5]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6219c45-d23a-43e0-966e-1d022b31f2ed]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acfd1dc-cd43-4cc2-bce4-39ee8554406c]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe, portal: 172.16.0.220,3260]
Nov 16 06:00:50 user nova-compute[80928]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe, portal: 172.16.0.220,3260] successful.
Nov 16 06:00:50 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:955878dc-c623-4dc9-a090-fd7273b34afe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6fcddb-48fe-4373-80d3-949c9258f707]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] <== disconnect_volume: return (293ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:00:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:00:51 user nova-compute[80928]: DEBUG nova.objects.instance [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'flavor' on Instance uuid 2bf7b0af-49ef-4cda-92e7-cb1834ba739f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:00:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0c301f99-7fa4-4320-b9ee-4191acc1a157 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.680s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:55 user nova-compute[80928]: INFO nova.compute.manager [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Terminating instance
Nov 16 06:00:55 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-ea5a5ac6-e2ae-4e16-8dfc-1766f3f384cb req-4a365b9b-f917-44e6-a290-d398032b1bfe service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-vif-unplugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ea5a5ac6-e2ae-4e16-8dfc-1766f3f384cb req-4a365b9b-f917-44e6-a290-d398032b1bfe service nova] Acquiring lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ea5a5ac6-e2ae-4e16-8dfc-1766f3f384cb req-4a365b9b-f917-44e6-a290-d398032b1bfe service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-ea5a5ac6-e2ae-4e16-8dfc-1766f3f384cb req-4a365b9b-f917-44e6-a290-d398032b1bfe service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-ea5a5ac6-e2ae-4e16-8dfc-1766f3f384cb req-4a365b9b-f917-44e6-a290-d398032b1bfe service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] No waiting events found dispatching network-vif-unplugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:00:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-ea5a5ac6-e2ae-4e16-8dfc-1766f3f384cb req-4a365b9b-f917-44e6-a290-d398032b1bfe service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-vif-unplugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Instance destroyed successfully.
Nov 16 06:00:56 user nova-compute[80928]: DEBUG nova.objects.instance [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lazy-loading 'resources' on Instance uuid 5dc200e9-4a4e-47cd-be4a-905c2f34186e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-731608245',display_name='tempest-TestVolumeBootPattern-volume-backed-server-731608245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-731608245',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOAe/uWwJ2uB8Tly+jijptHTKSuWlaDcyeK5Z6OaP1wN/oEQIPV5d9qAMsV9u/ljy+73kCD2zDQCI5AAWu9QQ6+e/LOc6HXJRdJUYfSRDUtvfEqnFcocol2bqU30stHYw==',key_name='tempest-keypair-1516066660',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:56:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-43mzvah3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:56:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=5dc200e9-4a4e-47cd-be4a-905c2f34186e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "address": "fa:16:3e:a8:49:b1", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ac81db-35", "ovs_interfaceid": "18ac81db-3540-4b1f-b16e-3fbbaf2671cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:49:b1,bridge_name='br-int',has_traffic_filtering=True,id=18ac81db-3540-4b1f-b16e-3fbbaf2671cb,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ac81db-35') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_vif [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:49:b1,bridge_name='br-int',has_traffic_filtering=True,id=18ac81db-3540-4b1f-b16e-3fbbaf2671cb,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ac81db-35') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18ac81db-35, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84e0026b-27d9-4245-b3f2-a09af48c28e4) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:00:56 user nova-compute[80928]: INFO os_vif [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:49:b1,bridge_name='br-int',has_traffic_filtering=True,id=18ac81db-3540-4b1f-b16e-3fbbaf2671cb,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ac81db-35')
Nov 16 06:00:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYARhmkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:00:56 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc926f6-20bb-4dc9-b2c8-cce068051c8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:00:56 user nova-compute[80928]: No targets found.
Nov 16 06:00:56 user nova-compute[80928]: iSNS:
Nov 16 06:00:56 user nova-compute[80928]: No targets found.
Nov 16 06:00:56 user nova-compute[80928]: STATIC:
Nov 16 06:00:56 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814
Nov 16 06:00:56 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:00:56 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:00:56 user nova-compute[80928]: FIRMWARE:
Nov 16 06:00:56 user nova-compute[80928]: No targets found.
Nov 16 06:00:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:00:56 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:00:56 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c47d6bf-0266-4442-8aac-0846c0f4d0b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d6420c-7535-4dba-a035-24341bf3a7c3]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 06:00:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 (non-flash)
Nov 16 06:00:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585a4790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb47591-3529-4e27-828e-a6e90f154a53]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae9e1c7-936c-403a-b462-3106e7b864d4]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[867a12df-559b-4c76-b7da-fc038ad2963e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97e86b8-453a-47d7-aaa3-9f147488d90b]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac115b17-f5ee-42a2-b093-d1a9e669e7dc]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e4b405-c2a4-4eeb-bfb4-1923cf1ec707]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814, portal: 172.16.0.220,3260]
Nov 16 06:00:56 user nova-compute[80928]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814, portal: 172.16.0.220,3260] successful.
Nov 16 06:00:56 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4412938-4663-4c36-8272-69a1814e6814 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b7f97a-849c-4e78-b19c-3403d88c3022]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== disconnect_volume: return (331ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:00:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Deleting instance files /opt/stack/data/nova/instances/5dc200e9-4a4e-47cd-be4a-905c2f34186e_del
Nov 16 06:00:56 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Deletion of /opt/stack/data/nova/instances/5dc200e9-4a4e-47cd-be4a-905c2f34186e_del complete
Nov 16 06:00:56 user nova-compute[80928]: INFO nova.compute.manager [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 16 06:00:56 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:00:57 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Took 0.77 seconds to deallocate network for instance.
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-1602036f-d06f-4fc7-aa63-b33d2beb438f req-81339ec5-7599-4d61-9951-5694da62829e service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-vif-deleted-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Acquiring lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] No waiting events found dispatching network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:00:57 user nova-compute[80928]: WARNING nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received unexpected event network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb for instance with vm_state active and task_state deleting.
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Acquiring lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] No waiting events found dispatching network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:00:57 user nova-compute[80928]: WARNING nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received unexpected event network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb for instance with vm_state active and task_state deleting.
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Acquiring lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] No waiting events found dispatching network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:00:57 user nova-compute[80928]: WARNING nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received unexpected event network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb for instance with vm_state active and task_state deleting.
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-vif-unplugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Acquiring lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] No waiting events found dispatching network-vif-unplugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-vif-unplugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received event network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Acquiring lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:57 user nova-compute[80928]: DEBUG nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] No waiting events found dispatching network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:00:57 user nova-compute[80928]: WARNING nova.compute.manager [req-4c7dbeaf-a77d-47e7-bd68-54aa74a4d36a req-30d9e473-7861-4219-9d19-1b643ba88bb3 service nova] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Received unexpected event network-vif-plugged-18ac81db-3540-4b1f-b16e-3fbbaf2671cb for instance with vm_state active and task_state deleting.
Nov 16 06:00:58 user nova-compute[80928]: INFO nova.compute.manager [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Took 0.72 seconds to detach 1 volumes for instance.
Nov 16 06:00:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 5dc200e9-4a4e-47cd-be4a-905c2f34186e] Deleting volume: f4412938-4663-4c36-8272-69a1814e6814 {{(pid=80928) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 06:00:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:00:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:00:58 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:00:58 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:00:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:00:58 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Deleted allocations for instance 5dc200e9-4a4e-47cd-be4a-905c2f34186e
Nov 16 06:00:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d3a602d2-01cb-4efa-93ac-0021a789a4fd tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "5dc200e9-4a4e-47cd-be4a-905c2f34186e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.142s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:01:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:01:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:01:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:01:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:09 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:01:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:01:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:16 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:01:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:01:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:01:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:21 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:22 user nova-compute[80928]: INFO nova.compute.manager [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Terminating instance
Nov 16 06:01:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-b0ce7cb4-d203-4710-8d9b-d5dafd53fda7 req-ae821866-f01b-4bde-a32b-2dc528cbffa1 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-unplugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b0ce7cb4-d203-4710-8d9b-d5dafd53fda7 req-ae821866-f01b-4bde-a32b-2dc528cbffa1 service nova] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b0ce7cb4-d203-4710-8d9b-d5dafd53fda7 req-ae821866-f01b-4bde-a32b-2dc528cbffa1 service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b0ce7cb4-d203-4710-8d9b-d5dafd53fda7 req-ae821866-f01b-4bde-a32b-2dc528cbffa1 service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-b0ce7cb4-d203-4710-8d9b-d5dafd53fda7 req-ae821866-f01b-4bde-a32b-2dc528cbffa1 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] No waiting events found dispatching network-vif-unplugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:01:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-b0ce7cb4-d203-4710-8d9b-d5dafd53fda7 req-ae821866-f01b-4bde-a32b-2dc528cbffa1 service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-unplugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Instance destroyed successfully.
Nov 16 06:01:23 user nova-compute[80928]: DEBUG nova.objects.instance [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lazy-loading 'resources' on Instance uuid 2bf7b0af-49ef-4cda-92e7-cb1834ba739f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:56:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1149662607',display_name='tempest-TestMinimumBasicScenario-server-1149662607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1149662607',id=42,image_ref='dda16e26-4629-4226-9d68-ab703faff3f3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPsA+PjjEiOXdKih1zD2jnf6T4/UWDjjjVAGiPegJUGBQVN7pOUlHNw/XeM1fOw9BZuMk7gt7oSju2+kty2hkbF0UOiF/1kEQRdpHx0ZkNi1bv4LBupgosFUgSkODOMaQ==',key_name='tempest-TestMinimumBasicScenario-1828250359',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:56:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eab83b1fb4d343d08be479f5c56eb843',ramdisk_id='',reservation_id='r-m43ropa8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dda16e26-4629-4226-9d68-ab703faff3f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-641847724',owner_user_name='tempest-TestMinimumBasicScenario-641847724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:58:44Z,user_data=None,user_id='6f68adc47ff640f6ae433684f457db57',uuid=2bf7b0af-49ef-4cda-92e7-cb1834ba739f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converting VIF {"id": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "address": "fa:16:3e:82:41:d1", "network": {"id": "a60aabc3-7253-4e2c-b92d-9d873c721359", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-632849100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eab83b1fb4d343d08be479f5c56eb843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3fe3b7-fb", "ovs_interfaceid": "de3fe3b7-fb26-4218-9188-f50986f7b7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:41:d1,bridge_name='br-int',has_traffic_filtering=True,id=de3fe3b7-fb26-4218-9188-f50986f7b7f0,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3fe3b7-fb') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG os_vif [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:41:d1,bridge_name='br-int',has_traffic_filtering=True,id=de3fe3b7-fb26-4218-9188-f50986f7b7f0,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3fe3b7-fb') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde3fe3b7-fb, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=025dab04-80ab-425a-a5cb-3ee0cc7eba85) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:01:23 user nova-compute[80928]: INFO os_vif [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:41:d1,bridge_name='br-int',has_traffic_filtering=True,id=de3fe3b7-fb26-4218-9188-f50986f7b7f0,network=Network(a60aabc3-7253-4e2c-b92d-9d873c721359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3fe3b7-fb')
Nov 16 06:01:23 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Deleting instance files /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f_del
Nov 16 06:01:23 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Deletion of /opt/stack/data/nova/instances/2bf7b0af-49ef-4cda-92e7-cb1834ba739f_del complete
Nov 16 06:01:23 user nova-compute[80928]: INFO nova.compute.manager [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 06:01:23 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:24 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:01:24 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Took 0.83 seconds to deallocate network for instance.
Nov 16 06:01:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:24 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:01:24 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:01:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:24 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Deleted allocations for instance 2bf7b0af-49ef-4cda-92e7-cb1834ba739f
Nov 16 06:01:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-095e4ab2-8d2c-49e1-aa02-8a24f84ee2e2 tempest-TestMinimumBasicScenario-641847724 tempest-TestMinimumBasicScenario-641847724-project-member] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.067s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:24 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:01:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:24 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:01:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] No waiting events found dispatching network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:01:25 user nova-compute[80928]: WARNING nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received unexpected event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 for instance with vm_state deleted and task_state None.
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] No waiting events found dispatching network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:01:25 user nova-compute[80928]: WARNING nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received unexpected event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 for instance with vm_state deleted and task_state None.
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] No waiting events found dispatching network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:01:25 user nova-compute[80928]: WARNING nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received unexpected event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 for instance with vm_state deleted and task_state None.
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] Acquiring lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] Lock "2bf7b0af-49ef-4cda-92e7-cb1834ba739f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] No waiting events found dispatching network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:01:25 user nova-compute[80928]: WARNING nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received unexpected event network-vif-plugged-de3fe3b7-fb26-4218-9188-f50986f7b7f0 for instance with vm_state deleted and task_state None.
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-d94058b4-d20b-454e-bbee-82f2ee385a31 req-f7e18aa0-ad21-42b1-9cb0-0e2faf6d8c0a service nova] [instance: 2bf7b0af-49ef-4cda-92e7-cb1834ba739f] Received event network-vif-deleted-de3fe3b7-fb26-4218-9188-f50986f7b7f0 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:01:25 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:01:25 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8855MB free_disk=25.23809051513672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 49340b1b-d59b-47b0-8370-2bc1e37df30f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:01:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:27 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:01:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:01:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:01:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:01:27 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:01:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updating instance_info_cache with network_info: [{"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:01:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:01:28 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:01:28 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:01:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:29 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:01:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:01:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-8cca57cf-1421-45ea-880d-06e615f6aa5d req-79101334-5279-4033-8e9d-8ba7a5aea077 service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Received event network-changed-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:01:34 user nova-compute[80928]: DEBUG nova.compute.manager [req-8cca57cf-1421-45ea-880d-06e615f6aa5d req-79101334-5279-4033-8e9d-8ba7a5aea077 service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Refreshing instance network info cache due to event network-changed-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:01:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8cca57cf-1421-45ea-880d-06e615f6aa5d req-79101334-5279-4033-8e9d-8ba7a5aea077 service nova] Acquiring lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:01:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8cca57cf-1421-45ea-880d-06e615f6aa5d req-79101334-5279-4033-8e9d-8ba7a5aea077 service nova] Acquired lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:01:34 user nova-compute[80928]: DEBUG nova.network.neutron [req-8cca57cf-1421-45ea-880d-06e615f6aa5d req-79101334-5279-4033-8e9d-8ba7a5aea077 service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Refreshing network info cache for port fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:01:34 user nova-compute[80928]: DEBUG nova.network.neutron [req-8cca57cf-1421-45ea-880d-06e615f6aa5d req-79101334-5279-4033-8e9d-8ba7a5aea077 service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updated VIF entry in instance network info cache for port fac97c08-1ee4-4c0b-a6ab-fd8060d8660c. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:01:34 user nova-compute[80928]: DEBUG nova.network.neutron [req-8cca57cf-1421-45ea-880d-06e615f6aa5d req-79101334-5279-4033-8e9d-8ba7a5aea077 service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updating instance_info_cache with network_info: [{"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:01:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8cca57cf-1421-45ea-880d-06e615f6aa5d req-79101334-5279-4033-8e9d-8ba7a5aea077 service nova] Releasing lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:01:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:36 user nova-compute[80928]: DEBUG nova.objects.instance [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 49340b1b-d59b-47b0-8370-2bc1e37df30f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:01:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:37 user nova-compute[80928]: INFO nova.compute.manager [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Attaching volume 119a6ae8-4c7f-49b8-adaa-919c908744bb to /dev/vdb
Nov 16 06:01:37 user nova-compute[80928]: DEBUG os_brick.utils [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c0aa5c-a262-4cd6-b2cb-22e1f040f467]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d861ab1a-61eb-44e0-b3be-821e1d7e5f8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66dcb19-3ca8-46f1-b920-0eb2516ef510]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d9d42f-51f0-433a-98f4-7569564cef57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:01:37 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:01:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6b04b1-abe0-462b-a370-7eabf8f6b5e6]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG os_brick.utils [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:01:37 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updating existing volume attachment record: 48f608ed-2bbd-4f50-9d6c-82257fbf158f {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:01:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDYuyVPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:01:41 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:01:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:01:41 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:01:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:01:41 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70823d0-a664-4380-8ccf-2fd56294c569]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:01:41 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca998d5-5eef-49b9-8db3-b6e80092e17e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb] added
Nov 16 06:01:41 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0b3cce-9cb5-44ce-ae6c-758868befeef]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2be688c-9c74-4634-a67a-3ed3f5162b64]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RDYuyVPz {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RDYuyVPz" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0b0c39-e8b6-4d28-9192-b3df029923bc]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RDYuyVPz'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefdc94b-7f39-4856-8b9e-6fca17953ef8]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8341bdc3-69c1-4720-bf77-870766f7a7ae]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:01:42 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:01:42 user nova-compute[80928]:  {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:01:42 user nova-compute[80928]: WARNING os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 06:01:42 user nova-compute[80928]: 
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fb92ce-f4c7-4695-8828-81d2c7aefbca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb, portal: 172.16.0.220,3260]
Nov 16 06:01:42 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb, portal: 172.16.0.220,3260] successful.
Nov 16 06:01:42 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa90982e-a70a-44ae-9940-89a8390c3ebd]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29705dc-bd45-47aa-b58c-8987808bc991]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)
Nov 16 06:01:42 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)
Nov 16 06:01:42 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c77e8e-5220-42f4-9606-80d36608d8b0]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:01:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDYuyVPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:01:43 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:01:43 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23733653836313733', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:01:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733653836313733', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:01:43 user nova-compute[80928]: DEBUG nova.objects.instance [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 49340b1b-d59b-47b0-8370-2bc1e37df30f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:01:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 06:01:43 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:01:43 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:01:43 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:01:43 user nova-compute[80928]:   <serial>119a6ae8-4c7f-49b8-adaa-919c908744bb</serial>
Nov 16 06:01:43 user nova-compute[80928]: </disk>
Nov 16 06:01:43 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 06:01:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:01:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:01:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No VIF found with MAC fa:16:3e:15:57:56, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:01:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-86006582-3481-4b90-9b43-31280fd07842 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.711s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 49340b1b-d59b-47b0-8370-2bc1e37df30f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:46 user nova-compute[80928]: INFO nova.compute.manager [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Attaching volume 188e2157-3795-491c-bddf-944c616a3fc3 to /dev/vdc
Nov 16 06:01:46 user nova-compute[80928]: DEBUG os_brick.utils [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[12275dc4-acfa-44d5-8b35-e0e45524d4c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b80a45-063f-4651-958a-48f07522de8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce7ca18-4a0e-4720-b390-8b790741daa6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4d36d4-6c8f-4d1d-8245-e3520e41490c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:01:46 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:01:46 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a938f1b5-3695-49dd-8041-cfb4435a3fc9]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG os_brick.utils [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:01:46 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updating existing volume attachment record: 4bda1567-3c50-4f71-a62c-9bbae8a9a324 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:01:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlLbWfqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:01:51 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:01:51 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:01:51 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4af6c7-8054-4914-afbb-8c02879eb2d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:01:51 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c0a2e3-cc90-4759-9a67-b1efea0f9679]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3] added
Nov 16 06:01:51 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e55378-4e99-431d-a63a-4c43c82d3d0a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8673043e-25a6-42d2-9f25-2b2e2d503fbd]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DlLbWfqA {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DlLbWfqA" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[165d342d-4346-4815-889f-0663acdfce3d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DlLbWfqA'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f21ce79-33c3-4a63-a7b9-dd0049db5230]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab9f476-a2f1-4136-a28f-04667c2fc196]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)
Nov 16 06:01:51 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)
Nov 16 06:01:51 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a267c35-2ced-4e9d-ba13-de496f846cd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3, portal: 172.16.0.220,3260]
Nov 16 06:01:51 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3, portal: 172.16.0.220,3260] successful.
Nov 16 06:01:51 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[611107db-421d-4ede-879a-01b447ccbdbd]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[571e1a9c-a006-4b64-b17f-7c549947ef98]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)
Nov 16 06:01:51 user nova-compute[80928]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)
Nov 16 06:01:51 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)
Nov 16 06:01:51 user nova-compute[80928]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)
Nov 16 06:01:51 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5074de0-d8c9-493a-87eb-1683ab33d2b9]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:01:51 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlLbWfqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:01:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:01:52 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26233306461353661', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:01:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233306461353661', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:01:52 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 49340b1b-d59b-47b0-8370-2bc1e37df30f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:01:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 06:01:52 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:01:52 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 06:01:52 user nova-compute[80928]:   <target dev="vdc" bus="virtio"/>
Nov 16 06:01:52 user nova-compute[80928]:   <serial>188e2157-3795-491c-bddf-944c616a3fc3</serial>
Nov 16 06:01:52 user nova-compute[80928]: </disk>
Nov 16 06:01:52 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 06:01:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:01:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:01:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No BDM found with device name vdc, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:01:53 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] No VIF found with MAC fa:16:3e:15:57:56, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:01:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c3877487-ab7c-4a4e-ac8e-138930afb018 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.852s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "45793e18-ec4a-404e-8910-adaf57e71048" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "45793e18-ec4a-404e-8910-adaf57e71048" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 06:01:54 user nova-compute[80928]: INFO nova.compute.claims [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Claim successful on node user
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:54 user nova-compute[80928]: INFO nova.compute.manager [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Detaching volume 119a6ae8-4c7f-49b8-adaa-919c908744bb
Nov 16 06:01:54 user nova-compute[80928]: INFO nova.virt.block_device [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Attempting to driver detach volume 119a6ae8-4c7f-49b8-adaa-919c908744bb from mountpoint /dev/vdb
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Attempting to detach device vdb from instance 49340b1b-d59b-47b0-8370-2bc1e37df30f from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:01:54 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:01:54 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:01:54 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:01:54 user nova-compute[80928]:   <serial>119a6ae8-4c7f-49b8-adaa-919c908744bb</serial>
Nov 16 06:01:54 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:01:54 user nova-compute[80928]: </disk>
Nov 16 06:01:54 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:01:54 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully detached device vdb from instance 49340b1b-d59b-47b0-8370-2bc1e37df30f from the persistent domain config.
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49340b1b-d59b-47b0-8370-2bc1e37df30f from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:01:54 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:01:54 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:01:54 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:01:54 user nova-compute[80928]:   <serial>119a6ae8-4c7f-49b8-adaa-919c908744bb</serial>
Nov 16 06:01:54 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:01:54 user nova-compute[80928]: </disk>
Nov 16 06:01:54 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 06:01:54 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.policy [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3613cf4088874d1699e1feee5f6edc9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90f29809d44adfb12039c9b7910275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 06:01:54 user nova-compute[80928]: INFO nova.virt.block_device [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Booting with volume 76a180df-0f5a-4d47-8f96-0a55f560e571 at /dev/vda
Nov 16 06:01:54 user nova-compute[80928]: DEBUG os_brick.utils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0438f7-bd54-4680-96c4-fe5a70ec7bdd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef3523f-bf21-4bd2-b2e5-8bd927e99d88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb9485-7e35-4bdf-86da-a7d80a2fa119]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8b6d69-2e8c-4b6a-9fb7-16224c0b6244]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49340b1b-d59b-47b0-8370-2bc1e37df30f {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:01:54 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:01:54 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bc1fa7-aaa7-4c61-aea2-b13062b222c4]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG os_brick.utils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:01:54 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Updating existing volume attachment record: 8eedfaff-f2f4-467e-9868-ed9a4b513253 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:01:55 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Successfully created port: 76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 06:01:55 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Successfully updated port: 76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 06:01:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "refresh_cache-45793e18-ec4a-404e-8910-adaf57e71048" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:01:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquired lock "refresh_cache-45793e18-ec4a-404e-8910-adaf57e71048" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:01:55 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 06:01:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-cfb0fd0b-89db-4a69-a390-5956e6e26b35 req-bd7f8f2a-21b9-4c8d-a8a2-36eee017280d service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Received event network-changed-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:01:55 user nova-compute[80928]: DEBUG nova.compute.manager [req-cfb0fd0b-89db-4a69-a390-5956e6e26b35 req-bd7f8f2a-21b9-4c8d-a8a2-36eee017280d service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Refreshing instance network info cache due to event network-changed-76abd7e4-97e9-445b-ad6c-787daf0f1ce7. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:01:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cfb0fd0b-89db-4a69-a390-5956e6e26b35 req-bd7f8f2a-21b9-4c8d-a8a2-36eee017280d service nova] Acquiring lock "refresh_cache-45793e18-ec4a-404e-8910-adaf57e71048" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:01:56 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 06:01:56 user nova-compute[80928]: DEBUG nova.network.neutron [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Updating instance_info_cache with network_info: [{"id": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "address": "fa:16:3e:d7:72:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76abd7e4-97", "ovs_interfaceid": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:01:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Releasing lock "refresh_cache-45793e18-ec4a-404e-8910-adaf57e71048" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:01:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Instance network_info: |[{"id": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "address": "fa:16:3e:d7:72:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76abd7e4-97", "ovs_interfaceid": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 06:01:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cfb0fd0b-89db-4a69-a390-5956e6e26b35 req-bd7f8f2a-21b9-4c8d-a8a2-36eee017280d service nova] Acquired lock "refresh_cache-45793e18-ec4a-404e-8910-adaf57e71048" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:01:56 user nova-compute[80928]: DEBUG nova.network.neutron [req-cfb0fd0b-89db-4a69-a390-5956e6e26b35 req-bd7f8f2a-21b9-4c8d-a8a2-36eee017280d service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Refreshing network info cache for port 76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:01:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:56 user nova-compute[80928]: DEBUG nova.network.neutron [req-cfb0fd0b-89db-4a69-a390-5956e6e26b35 req-bd7f8f2a-21b9-4c8d-a8a2-36eee017280d service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Updated VIF entry in instance network info cache for port 76abd7e4-97e9-445b-ad6c-787daf0f1ce7. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:01:56 user nova-compute[80928]: DEBUG nova.network.neutron [req-cfb0fd0b-89db-4a69-a390-5956e6e26b35 req-bd7f8f2a-21b9-4c8d-a8a2-36eee017280d service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Updating instance_info_cache with network_info: [{"id": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "address": "fa:16:3e:d7:72:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76abd7e4-97", "ovs_interfaceid": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:01:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cfb0fd0b-89db-4a69-a390-5956e6e26b35 req-bd7f8f2a-21b9-4c8d-a8a2-36eee017280d service nova] Releasing lock "refresh_cache-45793e18-ec4a-404e-8910-adaf57e71048" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:01:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:01:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 06:01:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 06:01:59 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Creating image(s)
Nov 16 06:01:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 06:01:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Ensure instance console log exists: /opt/stack/data/nova/instances/45793e18-ec4a-404e-8910-adaf57e71048/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 06:01:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:01:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:01:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:01:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Start _get_guest_xml network_info=[{"id": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "address": "fa:16:3e:d7:72:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76abd7e4-97", "ovs_interfaceid": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdHxjwFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45793e18-ec4a-404e-8910-adaf57e71048', 'attached_at': '', 'detached_at': '', 'volume_id': '76a180df-0f5a-4d47-8f96-0a55f560e571', 'serial': '76a180df-0f5a-4d47-8f96-0a55f560e571'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '8eedfaff-f2f4-467e-9868-ed9a4b513253', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 06:01:59 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:01:59 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdHxjwFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:02:00 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:02:00 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:02:00 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[371e13bf-bf2b-4705-848b-336b897e0b79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:02:00 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ceea95-ab0a-478e-aa07-886ebc610b08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571] added
Nov 16 06:02:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7457ba3-e7ce-4112-bd8f-3a4cd45bbfef]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c25ac01-a6a1-4bb5-ac28-53dbde406bc5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QdHxjwFP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QdHxjwFP" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bd4727-2a01-417d-b4b1-022f2399bc4c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QdHxjwFP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[405ae058-31f3-43c7-9d7e-e689579669e9]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6218d9a7-6bb6-4b51-9bac-5a56c9c93017]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)
Nov 16 06:02:00 user nova-compute[80928]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)
Nov 16 06:02:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)
Nov 16 06:02:00 user nova-compute[80928]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)
Nov 16 06:02:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37eb053-db05-4166-b0f1-38e26364b656]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260]
Nov 16 06:02:00 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260] successful.
Nov 16 06:02:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ed556c-88de-47d9-82bf-ab43737c8e78]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad26d44-c426-4fb7-9054-9a9bc9720058]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)
Nov 16 06:02:00 user nova-compute[80928]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)
Nov 16 06:02:00 user nova-compute[80928]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:02:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)
Nov 16 06:02:00 user nova-compute[80928]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)
Nov 16 06:02:00 user nova-compute[80928]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:02:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f542ea-74e2-4ac1-8577-85b1d3bc7ed7]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:02:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdHxjwFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26339313630616437', 'path': '/dev/sdd'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339313630616437', 'path': '/dev/sdd'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:01:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1146277427',display_name='tempest-TestVolumeBootPattern-server-1146277427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1146277427',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyY8s+sShXfJ+suwop52PyY173m6UiVR4KyrD50QIqQyrl3NE+BGSP1lDWf1O5bcLwC2JeVWfEj32kCuDLGs1JnxJaFNs8IkKGE+tPW/ARVCDA8B+/tdEVqq0AVOypNnA==',key_name='tempest-TestVolumeBootPattern-366323205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-umdd20a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:01:55Z,user_data=None,user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=45793e18-ec4a-404e-8910-adaf57e71048,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "address": "fa:16:3e:d7:72:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76abd7e4-97", "ovs_interfaceid": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "address": "fa:16:3e:d7:72:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76abd7e4-97", "ovs_interfaceid": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:49,bridge_name='br-int',has_traffic_filtering=True,id=76abd7e4-97e9-445b-ad6c-787daf0f1ce7,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76abd7e4-97') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lazy-loading 'pci_devices' on Instance uuid 45793e18-ec4a-404e-8910-adaf57e71048 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] End _get_guest_xml xml=<domain type="kvm">
Nov 16 06:02:01 user nova-compute[80928]:   <uuid>45793e18-ec4a-404e-8910-adaf57e71048</uuid>
Nov 16 06:02:01 user nova-compute[80928]:   <name>instance-0000002d</name>
Nov 16 06:02:01 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 06:02:01 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 06:02:01 user nova-compute[80928]:   <metadata>
Nov 16 06:02:01 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 06:02:01 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 06:02:01 user nova-compute[80928]:       <nova:name>tempest-TestVolumeBootPattern-server-1146277427</nova:name>
Nov 16 06:02:01 user nova-compute[80928]:       <nova:creationTime>2023-11-16 06:01:59</nova:creationTime>
Nov 16 06:02:01 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 06:02:01 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 06:02:01 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 06:02:01 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 06:02:01 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 06:02:01 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 06:02:01 user nova-compute[80928]:       </nova:flavor>
Nov 16 06:02:01 user nova-compute[80928]:       <nova:owner>
Nov 16 06:02:01 user nova-compute[80928]:         <nova:user uuid="3613cf4088874d1699e1feee5f6edc9f">tempest-TestVolumeBootPattern-315833619-project-member</nova:user>
Nov 16 06:02:01 user nova-compute[80928]:         <nova:project uuid="4b90f29809d44adfb12039c9b7910275">tempest-TestVolumeBootPattern-315833619</nova:project>
Nov 16 06:02:01 user nova-compute[80928]:       </nova:owner>
Nov 16 06:02:01 user nova-compute[80928]:       <nova:ports>
Nov 16 06:02:01 user nova-compute[80928]:         <nova:port uuid="76abd7e4-97e9-445b-ad6c-787daf0f1ce7">
Nov 16 06:02:01 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 06:02:01 user nova-compute[80928]:         </nova:port>
Nov 16 06:02:01 user nova-compute[80928]:       </nova:ports>
Nov 16 06:02:01 user nova-compute[80928]:     </nova:instance>
Nov 16 06:02:01 user nova-compute[80928]:   </metadata>
Nov 16 06:02:01 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 06:02:01 user nova-compute[80928]:     <system>
Nov 16 06:02:01 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 06:02:01 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 06:02:01 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 06:02:01 user nova-compute[80928]:       <entry name="serial">45793e18-ec4a-404e-8910-adaf57e71048</entry>
Nov 16 06:02:01 user nova-compute[80928]:       <entry name="uuid">45793e18-ec4a-404e-8910-adaf57e71048</entry>
Nov 16 06:02:01 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 06:02:01 user nova-compute[80928]:     </system>
Nov 16 06:02:01 user nova-compute[80928]:   </sysinfo>
Nov 16 06:02:01 user nova-compute[80928]:   <os>
Nov 16 06:02:01 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 06:02:01 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 06:02:01 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 06:02:01 user nova-compute[80928]:   </os>
Nov 16 06:02:01 user nova-compute[80928]:   <features>
Nov 16 06:02:01 user nova-compute[80928]:     <acpi/>
Nov 16 06:02:01 user nova-compute[80928]:     <apic/>
Nov 16 06:02:01 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 06:02:01 user nova-compute[80928]:   </features>
Nov 16 06:02:01 user nova-compute[80928]:   <clock offset="utc">
Nov 16 06:02:01 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 06:02:01 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 06:02:01 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 06:02:01 user nova-compute[80928]:   </clock>
Nov 16 06:02:01 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 06:02:01 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 06:02:01 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 06:02:01 user nova-compute[80928]:   </cpu>
Nov 16 06:02:01 user nova-compute[80928]:   <devices>
Nov 16 06:02:01 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 06:02:01 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:02:01 user nova-compute[80928]:       <source dev="/dev/sdd"/>
Nov 16 06:02:01 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 06:02:01 user nova-compute[80928]:       <serial>76a180df-0f5a-4d47-8f96-0a55f560e571</serial>
Nov 16 06:02:01 user nova-compute[80928]:     </disk>
Nov 16 06:02:01 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 06:02:01 user nova-compute[80928]:       <mac address="fa:16:3e:d7:72:49"/>
Nov 16 06:02:01 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:02:01 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 06:02:01 user nova-compute[80928]:       <target dev="tap76abd7e4-97"/>
Nov 16 06:02:01 user nova-compute[80928]:     </interface>
Nov 16 06:02:01 user nova-compute[80928]:     <serial type="pty">
Nov 16 06:02:01 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/45793e18-ec4a-404e-8910-adaf57e71048/console.log" append="off"/>
Nov 16 06:02:01 user nova-compute[80928]:     </serial>
Nov 16 06:02:01 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 06:02:01 user nova-compute[80928]:     <video>
Nov 16 06:02:01 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:02:01 user nova-compute[80928]:     </video>
Nov 16 06:02:01 user nova-compute[80928]:     <rng model="virtio">
Nov 16 06:02:01 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 06:02:01 user nova-compute[80928]:     </rng>
Nov 16 06:02:01 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 06:02:01 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 06:02:01 user nova-compute[80928]:       <stats period="10"/>
Nov 16 06:02:01 user nova-compute[80928]:     </memballoon>
Nov 16 06:02:01 user nova-compute[80928]:   </devices>
Nov 16 06:02:01 user nova-compute[80928]: </domain>
Nov 16 06:02:01 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:01:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1146277427',display_name='tempest-TestVolumeBootPattern-server-1146277427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1146277427',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyY8s+sShXfJ+suwop52PyY173m6UiVR4KyrD50QIqQyrl3NE+BGSP1lDWf1O5bcLwC2JeVWfEj32kCuDLGs1JnxJaFNs8IkKGE+tPW/ARVCDA8B+/tdEVqq0AVOypNnA==',key_name='tempest-TestVolumeBootPattern-366323205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-umdd20a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:01:55Z,user_data=None,user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=45793e18-ec4a-404e-8910-adaf57e71048,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "address": "fa:16:3e:d7:72:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76abd7e4-97", "ovs_interfaceid": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "address": "fa:16:3e:d7:72:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76abd7e4-97", "ovs_interfaceid": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:49,bridge_name='br-int',has_traffic_filtering=True,id=76abd7e4-97e9-445b-ad6c-787daf0f1ce7,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76abd7e4-97') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG os_vif [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:49,bridge_name='br-int',has_traffic_filtering=True,id=76abd7e4-97e9-445b-ad6c-787daf0f1ce7,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76abd7e4-97') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '683914fe-0da5-52e3-b8a1-93a291801f21', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76abd7e4-97, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76abd7e4-97, col_values=(('qos', UUID('0adc4447-ab25-44f8-b209-4b3b468b4327')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76abd7e4-97, col_values=(('external_ids', {'iface-id': '76abd7e4-97e9-445b-ad6c-787daf0f1ce7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:72:49', 'vm-uuid': '45793e18-ec4a-404e-8910-adaf57e71048'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:01 user nova-compute[80928]: INFO os_vif [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:72:49,bridge_name='br-int',has_traffic_filtering=True,id=76abd7e4-97e9-445b-ad6c-787daf0f1ce7,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76abd7e4-97')
Nov 16 06:02:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:02:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] No VIF found with MAC fa:16:3e:d7:72:49, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:02:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-299fc2d4-6e08-4457-beb5-3cc628984776 req-f0c2705e-b96c-4bac-881c-a4428673d9cc service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Received event network-vif-plugged-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:02:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-299fc2d4-6e08-4457-beb5-3cc628984776 req-f0c2705e-b96c-4bac-881c-a4428673d9cc service nova] Acquiring lock "45793e18-ec4a-404e-8910-adaf57e71048-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:02:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-299fc2d4-6e08-4457-beb5-3cc628984776 req-f0c2705e-b96c-4bac-881c-a4428673d9cc service nova] Lock "45793e18-ec4a-404e-8910-adaf57e71048-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:02:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-299fc2d4-6e08-4457-beb5-3cc628984776 req-f0c2705e-b96c-4bac-881c-a4428673d9cc service nova] Lock "45793e18-ec4a-404e-8910-adaf57e71048-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:02:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-299fc2d4-6e08-4457-beb5-3cc628984776 req-f0c2705e-b96c-4bac-881c-a4428673d9cc service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] No waiting events found dispatching network-vif-plugged-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:02:03 user nova-compute[80928]: WARNING nova.compute.manager [req-299fc2d4-6e08-4457-beb5-3cc628984776 req-f0c2705e-b96c-4bac-881c-a4428673d9cc service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Received unexpected event network-vif-plugged-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 for instance with vm_state building and task_state spawning.
Nov 16 06:02:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:04 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 06:02:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 06:02:04 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Instance spawned successfully.
Nov 16 06:02:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 06:02:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:02:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:02:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:02:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:02:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:02:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:02:04 user nova-compute[80928]: INFO nova.compute.manager [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 16 06:02:04 user nova-compute[80928]: DEBUG nova.compute.manager [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 06:02:05 user nova-compute[80928]: INFO nova.compute.manager [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Took 10.76 seconds to build instance.
Nov 16 06:02:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2bc839f3-7ea7-40cb-9f56-f04ad661c8a9 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "45793e18-ec4a-404e-8910-adaf57e71048" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.855s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:02:05 user nova-compute[80928]: DEBUG nova.compute.manager [req-068ba37a-7e0a-433a-847c-e3826c371aa2 req-45bbbe6b-70f9-4e05-9e00-1ad0376cb2d0 service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Received event network-vif-plugged-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:02:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-068ba37a-7e0a-433a-847c-e3826c371aa2 req-45bbbe6b-70f9-4e05-9e00-1ad0376cb2d0 service nova] Acquiring lock "45793e18-ec4a-404e-8910-adaf57e71048-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:02:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-068ba37a-7e0a-433a-847c-e3826c371aa2 req-45bbbe6b-70f9-4e05-9e00-1ad0376cb2d0 service nova] Lock "45793e18-ec4a-404e-8910-adaf57e71048-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:02:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-068ba37a-7e0a-433a-847c-e3826c371aa2 req-45bbbe6b-70f9-4e05-9e00-1ad0376cb2d0 service nova] Lock "45793e18-ec4a-404e-8910-adaf57e71048-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:02:05 user nova-compute[80928]: DEBUG nova.compute.manager [req-068ba37a-7e0a-433a-847c-e3826c371aa2 req-45bbbe6b-70f9-4e05-9e00-1ad0376cb2d0 service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] No waiting events found dispatching network-vif-plugged-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:02:05 user nova-compute[80928]: WARNING nova.compute.manager [req-068ba37a-7e0a-433a-847c-e3826c371aa2 req-45bbbe6b-70f9-4e05-9e00-1ad0376cb2d0 service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Received unexpected event network-vif-plugged-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 for instance with vm_state active and task_state None.
Nov 16 06:02:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:02:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:14 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 49340b1b-d59b-47b0-8370-2bc1e37df30f is timed out.
Nov 16 06:02:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully detached device vdb from instance 49340b1b-d59b-47b0-8370-2bc1e37df30f from the live domain config.
Nov 16 06:02:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDYuyVPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:02:14 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:02:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9ae17c-4bd2-4c8d-85b1-6c299146ac55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:02:14 user nova-compute[80928]: No targets found.
Nov 16 06:02:14 user nova-compute[80928]: iSNS:
Nov 16 06:02:14 user nova-compute[80928]: No targets found.
Nov 16 06:02:14 user nova-compute[80928]: STATIC:
Nov 16 06:02:14 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571
Nov 16 06:02:14 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:02:14 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:02:14 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb
Nov 16 06:02:14 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:02:14 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:02:14 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3
Nov 16 06:02:14 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:02:14 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:02:14 user nova-compute[80928]: FIRMWARE:
Nov 16 06:02:14 user nova-compute[80928]: No targets found.
Nov 16 06:02:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:02:14 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:02:14 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[88af360f-3524-404c-bac3-c94903f10a75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fad32bf-80a9-46b6-93b4-17b9ce604a7f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)
Nov 16 06:02:14 user nova-compute[80928]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)
Nov 16 06:02:14 user nova-compute[80928]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:02:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb (non-flash)
Nov 16 06:02:14 user nova-compute[80928]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)
Nov 16 06:02:14 user nova-compute[80928]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:02:14 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86583eca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:02:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efc9b61-2b3d-4c8e-9a5e-da461a035e8f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[958fb341-4b17-48c3-86a7-f8132db9e225]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fac496c-aad1-4e56-ae7a-84dddc21dc9f]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a69c49b-2718-4f4d-a4ef-40151a4c3a9c]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e7fe54-c7c1-4c27-b53d-1d479bfbfe2a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2528bf-c2c3-4233-83c5-ee333414fd3c]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb, portal: 172.16.0.220,3260]
Nov 16 06:02:15 user nova-compute[80928]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb, portal: 172.16.0.220,3260] successful.
Nov 16 06:02:15 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:119a6ae8-4c7f-49b8-adaa-919c908744bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede41d98-48d9-4077-a8d2-8fadf9e59e14]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] <== disconnect_volume: return (334ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:02:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:16 user nova-compute[80928]: DEBUG nova.objects.instance [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 49340b1b-d59b-47b0-8370-2bc1e37df30f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:02:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-636d2ce1-5e43-47b7-b8d4-513475e95160 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.759s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:02:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:02:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:02:17 user nova-compute[80928]: INFO nova.compute.manager [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Detaching volume 188e2157-3795-491c-bddf-944c616a3fc3
Nov 16 06:02:17 user nova-compute[80928]: INFO nova.virt.block_device [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Attempting to driver detach volume 188e2157-3795-491c-bddf-944c616a3fc3 from mountpoint /dev/vdc
Nov 16 06:02:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Attempting to detach device vdc from instance 49340b1b-d59b-47b0-8370-2bc1e37df30f from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 06:02:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:02:17 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:02:17 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 06:02:17 user nova-compute[80928]:   <target dev="vdc" bus="virtio"/>
Nov 16 06:02:17 user nova-compute[80928]:   <serial>188e2157-3795-491c-bddf-944c616a3fc3</serial>
Nov 16 06:02:17 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 06:02:17 user nova-compute[80928]: </disk>
Nov 16 06:02:17 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:02:17 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully detached device vdc from instance 49340b1b-d59b-47b0-8370-2bc1e37df30f from the persistent domain config.
Nov 16 06:02:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 49340b1b-d59b-47b0-8370-2bc1e37df30f from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 06:02:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:02:17 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:02:17 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 06:02:17 user nova-compute[80928]:   <target dev="vdc" bus="virtio"/>
Nov 16 06:02:17 user nova-compute[80928]:   <serial>188e2157-3795-491c-bddf-944c616a3fc3</serial>
Nov 16 06:02:17 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 06:02:17 user nova-compute[80928]: </disk>
Nov 16 06:02:17 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:02:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 49340b1b-d59b-47b0-8370-2bc1e37df30f {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 06:02:17 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:02:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:02:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:21 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:02:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:02:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:26 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:02:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:02:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:02:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:02:26 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:02:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 06:02:27 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:02:27 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:02:27 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=25.266178131103516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 49340b1b-d59b-47b0-8370-2bc1e37df30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 45793e18-ec4a-404e-8910-adaf57e71048 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:02:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:02:28 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:02:28 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:02:28 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:02:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:02:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:02:29 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:02:29 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 49340b1b-d59b-47b0-8370-2bc1e37df30f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:02:29 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updating instance_info_cache with network_info: [{"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:02:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-49340b1b-d59b-47b0-8370-2bc1e37df30f" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:02:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:02:29 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:02:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:31 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:02:31 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:02:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:37 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 49340b1b-d59b-47b0-8370-2bc1e37df30f is timed out.
Nov 16 06:02:37 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully detached device vdc from instance 49340b1b-d59b-47b0-8370-2bc1e37df30f from the live domain config.
Nov 16 06:02:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlLbWfqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:02:37 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b50fab3-b869-4efc-b57d-d6d2842fd079]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:02:37 user nova-compute[80928]: No targets found.
Nov 16 06:02:37 user nova-compute[80928]: iSNS:
Nov 16 06:02:37 user nova-compute[80928]: No targets found.
Nov 16 06:02:37 user nova-compute[80928]: STATIC:
Nov 16 06:02:37 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571
Nov 16 06:02:37 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:02:37 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:02:37 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3
Nov 16 06:02:37 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:02:37 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:02:37 user nova-compute[80928]: FIRMWARE:
Nov 16 06:02:37 user nova-compute[80928]: No targets found.
Nov 16 06:02:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:02:37 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:02:37 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0946c444-0731-4cb7-beff-9976b37c6966]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6fbc6f-5077-49b4-b386-7b865db2d265]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)
Nov 16 06:02:37 user nova-compute[80928]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:02:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 (non-flash)
Nov 16 06:02:37 user nova-compute[80928]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:02:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86785ca290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a66a02-c2b5-4c63-ad5d-153cbadf3a60]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3f9092-0d42-49dc-add7-350badf3d0a4]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdee8544-cf92-4956-b0f9-ef551a938683]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee547d1b-095c-471d-aeb3-9fe2f3714006]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa87788-6c25-48b0-ab0d-e9ddcd097d10]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe9c9d5-b613-4bde-90e6-2f1d2ebc7f02]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3, portal: 172.16.0.220,3260]
Nov 16 06:02:37 user nova-compute[80928]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3, portal: 172.16.0.220,3260] successful.
Nov 16 06:02:37 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188e2157-3795-491c-bddf-944c616a3fc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcd7a5c-241a-4399-94c8-26beec909b5e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] <== disconnect_volume: return (305ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:02:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:02:38 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'flavor' on Instance uuid 49340b1b-d59b-47b0-8370-2bc1e37df30f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:02:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1f3e07dd-58f8-4a71-9287-7173282636d8 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.702s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:02:40 user nova-compute[80928]: INFO nova.compute.manager [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Terminating instance
Nov 16 06:02:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-3d7be363-c991-49ef-a386-96ecd1a22639 req-cf06083e-488a-4e69-8762-4fafc649d06a service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Received event network-vif-unplugged-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3d7be363-c991-49ef-a386-96ecd1a22639 req-cf06083e-488a-4e69-8762-4fafc649d06a service nova] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3d7be363-c991-49ef-a386-96ecd1a22639 req-cf06083e-488a-4e69-8762-4fafc649d06a service nova] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3d7be363-c991-49ef-a386-96ecd1a22639 req-cf06083e-488a-4e69-8762-4fafc649d06a service nova] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-3d7be363-c991-49ef-a386-96ecd1a22639 req-cf06083e-488a-4e69-8762-4fafc649d06a service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] No waiting events found dispatching network-vif-unplugged-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-3d7be363-c991-49ef-a386-96ecd1a22639 req-cf06083e-488a-4e69-8762-4fafc649d06a service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Received event network-vif-unplugged-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Instance destroyed successfully.
Nov 16 06:02:40 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lazy-loading 'resources' on Instance uuid 49340b1b-d59b-47b0-8370-2bc1e37df30f {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T05:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-395964282',display_name='tempest-AttachVolumeTestJSON-server-395964282',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-395964282',id=44,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN860YL751Jk7JP/cjwZ0RDF54jX6kDLrT9RGztCuEdjY1f+M1ORC0iw3iqhcAoyfMYiO2f8TSa0MIEM0x34dGI/LgfiPQaHm4CN2VTwOTiatfHFzxElHkkhB5SzKH0Ixw==',key_name='tempest-keypair-1255951038',keypairs=<?>,launch_index=0,launched_at=2023-11-16T05:59:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05d6e74da88a497ca920dcb2e07ea05a',ramdisk_id='',reservation_id='r-80bk2k0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1530907565',owner_user_name='tempest-AttachVolumeTestJSON-1530907565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T05:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be30aca2412b475498f99dddb86c5983',uuid=49340b1b-d59b-47b0-8370-2bc1e37df30f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converting VIF {"id": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "address": "fa:16:3e:15:57:56", "network": {"id": "7e31ccbc-189b-4dc9-b8cd-603f9bb01b97", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-704302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05d6e74da88a497ca920dcb2e07ea05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac97c08-1e", "ovs_interfaceid": "fac97c08-1ee4-4c0b-a6ab-fd8060d8660c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:57:56,bridge_name='br-int',has_traffic_filtering=True,id=fac97c08-1ee4-4c0b-a6ab-fd8060d8660c,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac97c08-1e') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG os_vif [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:57:56,bridge_name='br-int',has_traffic_filtering=True,id=fac97c08-1ee4-4c0b-a6ab-fd8060d8660c,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac97c08-1e') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfac97c08-1e, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40a655c2-2fd2-452a-8c84-523a4ea82356) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:02:40 user nova-compute[80928]: INFO os_vif [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:57:56,bridge_name='br-int',has_traffic_filtering=True,id=fac97c08-1ee4-4c0b-a6ab-fd8060d8660c,network=Network(7e31ccbc-189b-4dc9-b8cd-603f9bb01b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac97c08-1e')
Nov 16 06:02:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Deleting instance files /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f_del
Nov 16 06:02:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Deletion of /opt/stack/data/nova/instances/49340b1b-d59b-47b0-8370-2bc1e37df30f_del complete
Nov 16 06:02:41 user nova-compute[80928]: INFO nova.compute.manager [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 06:02:41 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:02:41 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:02:41 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:02:41 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:02:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-d3b44f32-861e-4c0b-a60d-0652fb3b93ee req-557836eb-1613-4af8-87f3-30c9c9aeaa5e service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Received event network-vif-deleted-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:02:41 user nova-compute[80928]: INFO nova.compute.manager [req-d3b44f32-861e-4c0b-a60d-0652fb3b93ee req-557836eb-1613-4af8-87f3-30c9c9aeaa5e service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Neutron deleted interface fac97c08-1ee4-4c0b-a6ab-fd8060d8660c; detaching it from the instance and deleting it from the info cache
Nov 16 06:02:41 user nova-compute[80928]: DEBUG nova.network.neutron [req-d3b44f32-861e-4c0b-a60d-0652fb3b93ee req-557836eb-1613-4af8-87f3-30c9c9aeaa5e service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:02:41 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Took 0.74 seconds to deallocate network for instance.
Nov 16 06:02:41 user nova-compute[80928]: DEBUG nova.compute.manager [req-d3b44f32-861e-4c0b-a60d-0652fb3b93ee req-557836eb-1613-4af8-87f3-30c9c9aeaa5e service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Detach interface failed, port_id=fac97c08-1ee4-4c0b-a6ab-fd8060d8660c, reason: Instance 49340b1b-d59b-47b0-8370-2bc1e37df30f could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 06:02:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:02:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:02:41 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:02:41 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:02:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:02:42 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Deleted allocations for instance 49340b1b-d59b-47b0-8370-2bc1e37df30f
Nov 16 06:02:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f39a5b9e-bc1c-40da-b25c-36740f415738 tempest-AttachVolumeTestJSON-1530907565 tempest-AttachVolumeTestJSON-1530907565-project-member] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.953s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:02:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-43c97f40-7a35-4f46-98c7-75c094ee8c42 req-686e995e-13f6-4bad-8274-15ab565f7a49 service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Received event network-vif-plugged-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:02:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-43c97f40-7a35-4f46-98c7-75c094ee8c42 req-686e995e-13f6-4bad-8274-15ab565f7a49 service nova] Acquiring lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:02:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-43c97f40-7a35-4f46-98c7-75c094ee8c42 req-686e995e-13f6-4bad-8274-15ab565f7a49 service nova] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:02:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-43c97f40-7a35-4f46-98c7-75c094ee8c42 req-686e995e-13f6-4bad-8274-15ab565f7a49 service nova] Lock "49340b1b-d59b-47b0-8370-2bc1e37df30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:02:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-43c97f40-7a35-4f46-98c7-75c094ee8c42 req-686e995e-13f6-4bad-8274-15ab565f7a49 service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] No waiting events found dispatching network-vif-plugged-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:02:42 user nova-compute[80928]: WARNING nova.compute.manager [req-43c97f40-7a35-4f46-98c7-75c094ee8c42 req-686e995e-13f6-4bad-8274-15ab565f7a49 service nova] [instance: 49340b1b-d59b-47b0-8370-2bc1e37df30f] Received unexpected event network-vif-plugged-fac97c08-1ee4-4c0b-a6ab-fd8060d8660c for instance with vm_state deleted and task_state None.
Nov 16 06:02:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:02:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:02:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:03:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:03:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:03:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:03:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:03:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:03:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:03:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:10 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:03:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:03:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:03:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:03:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:03:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:17 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:03:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:03:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:03:23 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:03:23 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:03:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:03:28 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:03:28 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:03:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:03:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:03:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:03:28 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:03:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 06:03:29 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:03:29 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:03:29 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=25.292869567871094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:03:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:03:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:03:29 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 45793e18-ec4a-404e-8910-adaf57e71048 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:03:29 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:03:29 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:03:29 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:03:29 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:03:29 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:03:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:03:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:31 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:03:31 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:03:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-45793e18-ec4a-404e-8910-adaf57e71048" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:03:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-45793e18-ec4a-404e-8910-adaf57e71048" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:03:31 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:03:32 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Updating instance_info_cache with network_info: [{"id": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "address": "fa:16:3e:d7:72:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76abd7e4-97", "ovs_interfaceid": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:03:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-45793e18-ec4a-404e-8910-adaf57e71048" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:03:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:03:32 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:03:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:03:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:03:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-eee7a140-b31d-4c00-b7d5-8bcaaa9dff12 req-a8ac9777-c9c3-45a1-9309-723cae17575b service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Received event network-changed-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-eee7a140-b31d-4c00-b7d5-8bcaaa9dff12 req-a8ac9777-c9c3-45a1-9309-723cae17575b service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Refreshing instance network info cache due to event network-changed-76abd7e4-97e9-445b-ad6c-787daf0f1ce7. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-eee7a140-b31d-4c00-b7d5-8bcaaa9dff12 req-a8ac9777-c9c3-45a1-9309-723cae17575b service nova] Acquiring lock "refresh_cache-45793e18-ec4a-404e-8910-adaf57e71048" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-eee7a140-b31d-4c00-b7d5-8bcaaa9dff12 req-a8ac9777-c9c3-45a1-9309-723cae17575b service nova] Acquired lock "refresh_cache-45793e18-ec4a-404e-8910-adaf57e71048" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG nova.network.neutron [req-eee7a140-b31d-4c00-b7d5-8bcaaa9dff12 req-a8ac9777-c9c3-45a1-9309-723cae17575b service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Refreshing network info cache for port 76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "45793e18-ec4a-404e-8910-adaf57e71048" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "45793e18-ec4a-404e-8910-adaf57e71048" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "45793e18-ec4a-404e-8910-adaf57e71048-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "45793e18-ec4a-404e-8910-adaf57e71048-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "45793e18-ec4a-404e-8910-adaf57e71048-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:03:46 user nova-compute[80928]: INFO nova.compute.manager [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Terminating instance
Nov 16 06:03:46 user nova-compute[80928]: DEBUG nova.compute.manager [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG nova.network.neutron [req-eee7a140-b31d-4c00-b7d5-8bcaaa9dff12 req-a8ac9777-c9c3-45a1-9309-723cae17575b service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Updated VIF entry in instance network info cache for port 76abd7e4-97e9-445b-ad6c-787daf0f1ce7. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG nova.network.neutron [req-eee7a140-b31d-4c00-b7d5-8bcaaa9dff12 req-a8ac9777-c9c3-45a1-9309-723cae17575b service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Updating instance_info_cache with network_info: [{"id": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "address": "fa:16:3e:d7:72:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76abd7e4-97", "ovs_interfaceid": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-eee7a140-b31d-4c00-b7d5-8bcaaa9dff12 req-a8ac9777-c9c3-45a1-9309-723cae17575b service nova] Releasing lock "refresh_cache-45793e18-ec4a-404e-8910-adaf57e71048" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-753205fd-46fb-4dbe-a378-060970027ef5 req-482e14fd-305e-43c5-947e-4acdc44f8446 service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Received event network-vif-unplugged-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-753205fd-46fb-4dbe-a378-060970027ef5 req-482e14fd-305e-43c5-947e-4acdc44f8446 service nova] Acquiring lock "45793e18-ec4a-404e-8910-adaf57e71048-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-753205fd-46fb-4dbe-a378-060970027ef5 req-482e14fd-305e-43c5-947e-4acdc44f8446 service nova] Lock "45793e18-ec4a-404e-8910-adaf57e71048-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-753205fd-46fb-4dbe-a378-060970027ef5 req-482e14fd-305e-43c5-947e-4acdc44f8446 service nova] Lock "45793e18-ec4a-404e-8910-adaf57e71048-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-753205fd-46fb-4dbe-a378-060970027ef5 req-482e14fd-305e-43c5-947e-4acdc44f8446 service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] No waiting events found dispatching network-vif-unplugged-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:03:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-753205fd-46fb-4dbe-a378-060970027ef5 req-482e14fd-305e-43c5-947e-4acdc44f8446 service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Received event network-vif-unplugged-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:03:47 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Instance destroyed successfully.
Nov 16 06:03:47 user nova-compute[80928]: DEBUG nova.objects.instance [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lazy-loading 'resources' on Instance uuid 45793e18-ec4a-404e-8910-adaf57e71048 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:01:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1146277427',display_name='tempest-TestVolumeBootPattern-server-1146277427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1146277427',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyY8s+sShXfJ+suwop52PyY173m6UiVR4KyrD50QIqQyrl3NE+BGSP1lDWf1O5bcLwC2JeVWfEj32kCuDLGs1JnxJaFNs8IkKGE+tPW/ARVCDA8B+/tdEVqq0AVOypNnA==',key_name='tempest-TestVolumeBootPattern-366323205',keypairs=<?>,launch_index=0,launched_at=2023-11-16T06:02:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-umdd20a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T06:02:05Z,user_data=None,user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=45793e18-ec4a-404e-8910-adaf57e71048,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "address": "fa:16:3e:d7:72:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76abd7e4-97", "ovs_interfaceid": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "address": "fa:16:3e:d7:72:49", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76abd7e4-97", "ovs_interfaceid": "76abd7e4-97e9-445b-ad6c-787daf0f1ce7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:72:49,bridge_name='br-int',has_traffic_filtering=True,id=76abd7e4-97e9-445b-ad6c-787daf0f1ce7,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76abd7e4-97') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_vif [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:72:49,bridge_name='br-int',has_traffic_filtering=True,id=76abd7e4-97e9-445b-ad6c-787daf0f1ce7,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76abd7e4-97') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76abd7e4-97, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0adc4447-ab25-44f8-b209-4b3b468b4327) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:03:47 user nova-compute[80928]: INFO os_vif [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:72:49,bridge_name='br-int',has_traffic_filtering=True,id=76abd7e4-97e9-445b-ad6c-787daf0f1ce7,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76abd7e4-97')
Nov 16 06:03:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdHxjwFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:03:47 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ee16ab-7d58-4456-aff6-476fc0fd23c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:03:47 user nova-compute[80928]: No targets found.
Nov 16 06:03:47 user nova-compute[80928]: iSNS:
Nov 16 06:03:47 user nova-compute[80928]: No targets found.
Nov 16 06:03:47 user nova-compute[80928]: STATIC:
Nov 16 06:03:47 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571
Nov 16 06:03:47 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:03:47 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:03:47 user nova-compute[80928]: FIRMWARE:
Nov 16 06:03:47 user nova-compute[80928]: No targets found.
Nov 16 06:03:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:03:47 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:03:47 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6457a3b1-f84c-4928-80f8-3b33dc36fe92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6752edac-7359-4f30-bd7f-74696f4ad49f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:03:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:03:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86583fd5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571'): ({'sdd'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Removing single pathed devices sdd {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c263ce-6300-43bc-8bb7-32828724253d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[652d662b-763b-4801-a9a3-bde9a3774070]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flushing IO for device /dev/sdd {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c197dd7e-610c-4961-894f-328b0a1842cf]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba396dc-64e3-4f7e-b13f-d021a7f52eac]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] SCSI volumes sdd have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3684219b-c9160ad7add77edb', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3684219b', '/dev/disk/by-id/scsi-26339313630616437') {{(pid=92262) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5b318a-b3d6-49ed-8478-de5d665ead8f]: (4, None) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[25daf09b-3825-46e7-aa61-8904f8f6d478]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf0540e-8ba2-476c-b31d-992c5ff2cb7b]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260]
Nov 16 06:03:47 user nova-compute[80928]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260] successful.
Nov 16 06:03:47 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80ab332-e480-4c24-85d7-21bae6915905]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== disconnect_volume: return (294ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:03:47 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Deleting instance files /opt/stack/data/nova/instances/45793e18-ec4a-404e-8910-adaf57e71048_del
Nov 16 06:03:47 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Deletion of /opt/stack/data/nova/instances/45793e18-ec4a-404e-8910-adaf57e71048_del complete
Nov 16 06:03:47 user nova-compute[80928]: INFO nova.compute.manager [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 16 06:03:47 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:03:47 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:03:48 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:03:48 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Took 1.16 seconds to deallocate network for instance.
Nov 16 06:03:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-8d177572-40a5-4d89-928f-552dc10abc4d req-b3c9dd2c-198f-4a09-89e0-56fd9c204488 service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Received event network-vif-deleted-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:03:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-6744a9f1-d1b3-4d16-a942-2623a25e14e5 req-f804aff9-e64c-4cfe-a8f4-78bf7242eb21 service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Received event network-vif-plugged-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:03:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6744a9f1-d1b3-4d16-a942-2623a25e14e5 req-f804aff9-e64c-4cfe-a8f4-78bf7242eb21 service nova] Acquiring lock "45793e18-ec4a-404e-8910-adaf57e71048-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:03:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6744a9f1-d1b3-4d16-a942-2623a25e14e5 req-f804aff9-e64c-4cfe-a8f4-78bf7242eb21 service nova] Lock "45793e18-ec4a-404e-8910-adaf57e71048-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:03:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6744a9f1-d1b3-4d16-a942-2623a25e14e5 req-f804aff9-e64c-4cfe-a8f4-78bf7242eb21 service nova] Lock "45793e18-ec4a-404e-8910-adaf57e71048-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:03:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-6744a9f1-d1b3-4d16-a942-2623a25e14e5 req-f804aff9-e64c-4cfe-a8f4-78bf7242eb21 service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] No waiting events found dispatching network-vif-plugged-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:03:49 user nova-compute[80928]: WARNING nova.compute.manager [req-6744a9f1-d1b3-4d16-a942-2623a25e14e5 req-f804aff9-e64c-4cfe-a8f4-78bf7242eb21 service nova] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Received unexpected event network-vif-plugged-76abd7e4-97e9-445b-ad6c-787daf0f1ce7 for instance with vm_state active and task_state deleting.
Nov 16 06:03:49 user nova-compute[80928]: INFO nova.compute.manager [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 45793e18-ec4a-404e-8910-adaf57e71048] Took 0.72 seconds to detach 1 volumes for instance.
Nov 16 06:03:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:03:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:03:49 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:03:49 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:03:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:03:49 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Deleted allocations for instance 45793e18-ec4a-404e-8910-adaf57e71048
Nov 16 06:03:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-5130bef6-88c0-4f61-88ae-ca5d38b27d3b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "45793e18-ec4a-404e-8910-adaf57e71048" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.392s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:03:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:03:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:04:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:04:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:04:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:04:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:04:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:04:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:11 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:04:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "d931d111-887d-4a40-835c-4678661d5384" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "d931d111-887d-4a40-835c-4678661d5384" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 06:04:16 user nova-compute[80928]: INFO nova.compute.claims [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Claim successful on node user
Nov 16 06:04:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 06:04:16 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 06:04:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG nova.policy [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56314c196f8c49eca27951f9bb8fcd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3ac7d0f0bd4e60b5ea5403820f1dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 06:04:16 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Creating image(s)
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "/opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "/opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "/opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.171s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk 1073741824" returned: 0 in 0.054s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Successfully created port: f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Cannot resize image /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Ensure instance console log exists: /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Successfully updated port: f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "refresh_cache-d931d111-887d-4a40-835c-4678661d5384" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquired lock "refresh_cache-d931d111-887d-4a40-835c-4678661d5384" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-f96f5c1d-4cb6-4499-b254-787326028021 req-d930a906-6e6c-4f01-8ff0-1e138bfc83e8 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Received event network-changed-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-f96f5c1d-4cb6-4499-b254-787326028021 req-d930a906-6e6c-4f01-8ff0-1e138bfc83e8 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Refreshing instance network info cache due to event network-changed-f4a4a586-1b38-4f42-8106-2fc2ab4588f7. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f96f5c1d-4cb6-4499-b254-787326028021 req-d930a906-6e6c-4f01-8ff0-1e138bfc83e8 service nova] Acquiring lock "refresh_cache-d931d111-887d-4a40-835c-4678661d5384" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.network.neutron [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Updating instance_info_cache with network_info: [{"id": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "address": "fa:16:3e:ff:86:74", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a4a586-1b", "ovs_interfaceid": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Releasing lock "refresh_cache-d931d111-887d-4a40-835c-4678661d5384" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Instance network_info: |[{"id": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "address": "fa:16:3e:ff:86:74", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a4a586-1b", "ovs_interfaceid": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f96f5c1d-4cb6-4499-b254-787326028021 req-d930a906-6e6c-4f01-8ff0-1e138bfc83e8 service nova] Acquired lock "refresh_cache-d931d111-887d-4a40-835c-4678661d5384" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.network.neutron [req-f96f5c1d-4cb6-4499-b254-787326028021 req-d930a906-6e6c-4f01-8ff0-1e138bfc83e8 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Refreshing network info cache for port f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Start _get_guest_xml network_info=[{"id": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "address": "fa:16:3e:ff:86:74", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a4a586-1b", "ovs_interfaceid": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 06:04:18 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:04:18 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1105563011',display_name='tempest-VolumesActionsTest-instance-1105563011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1105563011',id=46,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc3ac7d0f0bd4e60b5ea5403820f1dba',ramdisk_id='',reservation_id='r-00s2px8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-429150892',owner_user_name='tempest-VolumesActionsTest-429150892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:04:17Z,user_data=None,user_id='56314c196f8c49eca27951f9bb8fcd57',uuid=d931d111-887d-4a40-835c-4678661d5384,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "address": "fa:16:3e:ff:86:74", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a4a586-1b", "ovs_interfaceid": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Converting VIF {"id": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "address": "fa:16:3e:ff:86:74", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a4a586-1b", "ovs_interfaceid": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:86:74,bridge_name='br-int',has_traffic_filtering=True,id=f4a4a586-1b38-4f42-8106-2fc2ab4588f7,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a4a586-1b') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lazy-loading 'pci_devices' on Instance uuid d931d111-887d-4a40-835c-4678661d5384 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] End _get_guest_xml xml=<domain type="kvm">
Nov 16 06:04:18 user nova-compute[80928]:   <uuid>d931d111-887d-4a40-835c-4678661d5384</uuid>
Nov 16 06:04:18 user nova-compute[80928]:   <name>instance-0000002e</name>
Nov 16 06:04:18 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 06:04:18 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 06:04:18 user nova-compute[80928]:   <metadata>
Nov 16 06:04:18 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 06:04:18 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 06:04:18 user nova-compute[80928]:       <nova:name>tempest-VolumesActionsTest-instance-1105563011</nova:name>
Nov 16 06:04:18 user nova-compute[80928]:       <nova:creationTime>2023-11-16 06:04:18</nova:creationTime>
Nov 16 06:04:18 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 06:04:18 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 06:04:18 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 06:04:18 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 06:04:18 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 06:04:18 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 06:04:18 user nova-compute[80928]:       </nova:flavor>
Nov 16 06:04:18 user nova-compute[80928]:       <nova:owner>
Nov 16 06:04:18 user nova-compute[80928]:         <nova:user uuid="56314c196f8c49eca27951f9bb8fcd57">tempest-VolumesActionsTest-429150892-project-member</nova:user>
Nov 16 06:04:18 user nova-compute[80928]:         <nova:project uuid="cc3ac7d0f0bd4e60b5ea5403820f1dba">tempest-VolumesActionsTest-429150892</nova:project>
Nov 16 06:04:18 user nova-compute[80928]:       </nova:owner>
Nov 16 06:04:18 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 06:04:18 user nova-compute[80928]:       <nova:ports>
Nov 16 06:04:18 user nova-compute[80928]:         <nova:port uuid="f4a4a586-1b38-4f42-8106-2fc2ab4588f7">
Nov 16 06:04:18 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 06:04:18 user nova-compute[80928]:         </nova:port>
Nov 16 06:04:18 user nova-compute[80928]:       </nova:ports>
Nov 16 06:04:18 user nova-compute[80928]:     </nova:instance>
Nov 16 06:04:18 user nova-compute[80928]:   </metadata>
Nov 16 06:04:18 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 06:04:18 user nova-compute[80928]:     <system>
Nov 16 06:04:18 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 06:04:18 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 06:04:18 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 06:04:18 user nova-compute[80928]:       <entry name="serial">d931d111-887d-4a40-835c-4678661d5384</entry>
Nov 16 06:04:18 user nova-compute[80928]:       <entry name="uuid">d931d111-887d-4a40-835c-4678661d5384</entry>
Nov 16 06:04:18 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 06:04:18 user nova-compute[80928]:     </system>
Nov 16 06:04:18 user nova-compute[80928]:   </sysinfo>
Nov 16 06:04:18 user nova-compute[80928]:   <os>
Nov 16 06:04:18 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 06:04:18 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 06:04:18 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 06:04:18 user nova-compute[80928]:   </os>
Nov 16 06:04:18 user nova-compute[80928]:   <features>
Nov 16 06:04:18 user nova-compute[80928]:     <acpi/>
Nov 16 06:04:18 user nova-compute[80928]:     <apic/>
Nov 16 06:04:18 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 06:04:18 user nova-compute[80928]:   </features>
Nov 16 06:04:18 user nova-compute[80928]:   <clock offset="utc">
Nov 16 06:04:18 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 06:04:18 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 06:04:18 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 06:04:18 user nova-compute[80928]:   </clock>
Nov 16 06:04:18 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 06:04:18 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 06:04:18 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 06:04:18 user nova-compute[80928]:   </cpu>
Nov 16 06:04:18 user nova-compute[80928]:   <devices>
Nov 16 06:04:18 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 06:04:18 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 06:04:18 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk"/>
Nov 16 06:04:18 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 06:04:18 user nova-compute[80928]:     </disk>
Nov 16 06:04:18 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 06:04:18 user nova-compute[80928]:       <mac address="fa:16:3e:ff:86:74"/>
Nov 16 06:04:18 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:04:18 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 06:04:18 user nova-compute[80928]:       <target dev="tapf4a4a586-1b"/>
Nov 16 06:04:18 user nova-compute[80928]:     </interface>
Nov 16 06:04:18 user nova-compute[80928]:     <serial type="pty">
Nov 16 06:04:18 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/console.log" append="off"/>
Nov 16 06:04:18 user nova-compute[80928]:     </serial>
Nov 16 06:04:18 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 06:04:18 user nova-compute[80928]:     <video>
Nov 16 06:04:18 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:04:18 user nova-compute[80928]:     </video>
Nov 16 06:04:18 user nova-compute[80928]:     <rng model="virtio">
Nov 16 06:04:18 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 06:04:18 user nova-compute[80928]:     </rng>
Nov 16 06:04:18 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 06:04:18 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 06:04:18 user nova-compute[80928]:       <stats period="10"/>
Nov 16 06:04:18 user nova-compute[80928]:     </memballoon>
Nov 16 06:04:18 user nova-compute[80928]:   </devices>
Nov 16 06:04:18 user nova-compute[80928]: </domain>
Nov 16 06:04:18 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1105563011',display_name='tempest-VolumesActionsTest-instance-1105563011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1105563011',id=46,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc3ac7d0f0bd4e60b5ea5403820f1dba',ramdisk_id='',reservation_id='r-00s2px8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-429150892',owner_user_name='tempest-VolumesActionsTest-429150892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:04:17Z,user_data=None,user_id='56314c196f8c49eca27951f9bb8fcd57',uuid=d931d111-887d-4a40-835c-4678661d5384,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "address": "fa:16:3e:ff:86:74", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a4a586-1b", "ovs_interfaceid": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Converting VIF {"id": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "address": "fa:16:3e:ff:86:74", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a4a586-1b", "ovs_interfaceid": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:86:74,bridge_name='br-int',has_traffic_filtering=True,id=f4a4a586-1b38-4f42-8106-2fc2ab4588f7,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a4a586-1b') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG os_vif [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:86:74,bridge_name='br-int',has_traffic_filtering=True,id=f4a4a586-1b38-4f42-8106-2fc2ab4588f7,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a4a586-1b') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71115515-5545-5595-81e3-612c81c8584d', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4a4a586-1b, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4a4a586-1b, col_values=(('qos', UUID('8cbf1591-16db-460c-9613-34483b7df16b')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4a4a586-1b, col_values=(('external_ids', {'iface-id': 'f4a4a586-1b38-4f42-8106-2fc2ab4588f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:86:74', 'vm-uuid': 'd931d111-887d-4a40-835c-4678661d5384'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:18 user nova-compute[80928]: INFO os_vif [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:86:74,bridge_name='br-int',has_traffic_filtering=True,id=f4a4a586-1b38-4f42-8106-2fc2ab4588f7,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a4a586-1b')
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:04:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] No VIF found with MAC fa:16:3e:ff:86:74, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:04:19 user nova-compute[80928]: DEBUG nova.network.neutron [req-f96f5c1d-4cb6-4499-b254-787326028021 req-d930a906-6e6c-4f01-8ff0-1e138bfc83e8 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Updated VIF entry in instance network info cache for port f4a4a586-1b38-4f42-8106-2fc2ab4588f7. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:04:19 user nova-compute[80928]: DEBUG nova.network.neutron [req-f96f5c1d-4cb6-4499-b254-787326028021 req-d930a906-6e6c-4f01-8ff0-1e138bfc83e8 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Updating instance_info_cache with network_info: [{"id": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "address": "fa:16:3e:ff:86:74", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a4a586-1b", "ovs_interfaceid": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:04:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f96f5c1d-4cb6-4499-b254-787326028021 req-d930a906-6e6c-4f01-8ff0-1e138bfc83e8 service nova] Releasing lock "refresh_cache-d931d111-887d-4a40-835c-4678661d5384" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:04:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-37c403b2-7c71-4fde-a9ee-ae79edba5edb req-509be745-4e63-432a-8232-e757f60ba73c service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Received event network-vif-plugged-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:04:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-37c403b2-7c71-4fde-a9ee-ae79edba5edb req-509be745-4e63-432a-8232-e757f60ba73c service nova] Acquiring lock "d931d111-887d-4a40-835c-4678661d5384-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-37c403b2-7c71-4fde-a9ee-ae79edba5edb req-509be745-4e63-432a-8232-e757f60ba73c service nova] Lock "d931d111-887d-4a40-835c-4678661d5384-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-37c403b2-7c71-4fde-a9ee-ae79edba5edb req-509be745-4e63-432a-8232-e757f60ba73c service nova] Lock "d931d111-887d-4a40-835c-4678661d5384-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-37c403b2-7c71-4fde-a9ee-ae79edba5edb req-509be745-4e63-432a-8232-e757f60ba73c service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] No waiting events found dispatching network-vif-plugged-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:04:20 user nova-compute[80928]: WARNING nova.compute.manager [req-37c403b2-7c71-4fde-a9ee-ae79edba5edb req-509be745-4e63-432a-8232-e757f60ba73c service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Received unexpected event network-vif-plugged-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 for instance with vm_state building and task_state spawning.
Nov 16 06:04:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 06:04:22 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: d931d111-887d-4a40-835c-4678661d5384] Instance spawned successfully.
Nov 16 06:04:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-733715ce-89f2-45e1-9c2d-a782d81b3104 req-a050e4e3-170f-4b15-b9fb-3f4af72657c6 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Received event network-vif-plugged-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-733715ce-89f2-45e1-9c2d-a782d81b3104 req-a050e4e3-170f-4b15-b9fb-3f4af72657c6 service nova] Acquiring lock "d931d111-887d-4a40-835c-4678661d5384-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-733715ce-89f2-45e1-9c2d-a782d81b3104 req-a050e4e3-170f-4b15-b9fb-3f4af72657c6 service nova] Lock "d931d111-887d-4a40-835c-4678661d5384-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-733715ce-89f2-45e1-9c2d-a782d81b3104 req-a050e4e3-170f-4b15-b9fb-3f4af72657c6 service nova] Lock "d931d111-887d-4a40-835c-4678661d5384-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG nova.compute.manager [req-733715ce-89f2-45e1-9c2d-a782d81b3104 req-a050e4e3-170f-4b15-b9fb-3f4af72657c6 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] No waiting events found dispatching network-vif-plugged-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:04:22 user nova-compute[80928]: WARNING nova.compute.manager [req-733715ce-89f2-45e1-9c2d-a782d81b3104 req-a050e4e3-170f-4b15-b9fb-3f4af72657c6 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Received unexpected event network-vif-plugged-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 for instance with vm_state building and task_state spawning.
Nov 16 06:04:22 user nova-compute[80928]: INFO nova.compute.manager [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 16 06:04:22 user nova-compute[80928]: DEBUG nova.compute.manager [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 06:04:22 user nova-compute[80928]: INFO nova.compute.manager [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Took 6.27 seconds to build instance.
Nov 16 06:04:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1029f1d4-0a70-4a6e-baf1-abe903400a4d tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "d931d111-887d-4a40-835c-4678661d5384" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.362s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:04:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:04:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:25 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:04:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:29 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:04:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:29 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:04:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:30 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:04:30 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:04:30 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=25.28845977783203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:04:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:30 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance d931d111-887d-4a40-835c-4678661d5384 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:04:30 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:04:30 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:04:30 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:04:30 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:04:30 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:04:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:31 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:04:31 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:04:31 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:04:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-d931d111-887d-4a40-835c-4678661d5384" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:04:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-d931d111-887d-4a40-835c-4678661d5384" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:04:32 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: d931d111-887d-4a40-835c-4678661d5384] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:04:32 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid d931d111-887d-4a40-835c-4678661d5384 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:04:32 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: d931d111-887d-4a40-835c-4678661d5384] Updating instance_info_cache with network_info: [{"id": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "address": "fa:16:3e:ff:86:74", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a4a586-1b", "ovs_interfaceid": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:04:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-d931d111-887d-4a40-835c-4678661d5384" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:04:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: d931d111-887d-4a40-835c-4678661d5384] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:04:32 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:04:33 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:04:33 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:04:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 06:04:38 user nova-compute[80928]: INFO nova.compute.claims [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Claim successful on node user
Nov 16 06:04:38 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG nova.network.neutron [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 06:04:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 06:04:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG nova.policy [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3613cf4088874d1699e1feee5f6edc9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90f29809d44adfb12039c9b7910275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 06:04:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:38 user nova-compute[80928]: INFO nova.virt.block_device [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Booting with volume 76a180df-0f5a-4d47-8f96-0a55f560e571 at /dev/vda
Nov 16 06:04:39 user nova-compute[80928]: DEBUG os_brick.utils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0141730b-b87f-4240-8184-f65757071c6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d258e41-1271-47ce-9cae-85e2a924a585]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd34ba4-9b87-46cd-bbbb-482f7c6f3082]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1600a9d-9123-4a06-b18f-7b0b9ef42946]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:04:39 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:04:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8826d2-2cc9-4267-8bd4-803720cf9705]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG os_brick.utils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updating existing volume attachment record: 18d46ba2-826f-4536-a999-96fc68c81b44 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:39 user nova-compute[80928]: DEBUG nova.network.neutron [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Successfully created port: f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG nova.network.neutron [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Successfully updated port: f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquired lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG nova.network.neutron [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-24f779c0-5362-47ef-b6d9-48114b4b69ad req-74155f71-0d40-47f3-b9af-c53bc6b1611b service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Received event network-changed-f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG nova.compute.manager [req-24f779c0-5362-47ef-b6d9-48114b4b69ad req-74155f71-0d40-47f3-b9af-c53bc6b1611b service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Refreshing instance network info cache due to event network-changed-f446e49a-0402-478e-94bb-3c2a2dd4b10f. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-24f779c0-5362-47ef-b6d9-48114b4b69ad req-74155f71-0d40-47f3-b9af-c53bc6b1611b service nova] Acquiring lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG nova.network.neutron [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG nova.network.neutron [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updating instance_info_cache with network_info: [{"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Releasing lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Instance network_info: |[{"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-24f779c0-5362-47ef-b6d9-48114b4b69ad req-74155f71-0d40-47f3-b9af-c53bc6b1611b service nova] Acquired lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG nova.network.neutron [req-24f779c0-5362-47ef-b6d9-48114b4b69ad req-74155f71-0d40-47f3-b9af-c53bc6b1611b service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Refreshing network info cache for port f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG nova.network.neutron [req-24f779c0-5362-47ef-b6d9-48114b4b69ad req-74155f71-0d40-47f3-b9af-c53bc6b1611b service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updated VIF entry in instance network info cache for port f446e49a-0402-478e-94bb-3c2a2dd4b10f. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG nova.network.neutron [req-24f779c0-5362-47ef-b6d9-48114b4b69ad req-74155f71-0d40-47f3-b9af-c53bc6b1611b service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updating instance_info_cache with network_info: [{"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:04:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-24f779c0-5362-47ef-b6d9-48114b4b69ad req-74155f71-0d40-47f3-b9af-c53bc6b1611b service nova] Releasing lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:04:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.compute.manager [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 06:04:44 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Creating image(s)
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Ensure instance console log exists: /opt/stack/data/nova/instances/8b807b7a-3f9d-4558-9f1f-51a155d0fe51/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Start _get_guest_xml network_info=[{"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdHxjwFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8b807b7a-3f9d-4558-9f1f-51a155d0fe51', 'attached_at': '', 'detached_at': '', 'volume_id': '76a180df-0f5a-4d47-8f96-0a55f560e571', 'serial': '76a180df-0f5a-4d47-8f96-0a55f560e571'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '18d46ba2-826f-4536-a999-96fc68c81b44', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 06:04:44 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:04:44 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdHxjwFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:04:44 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:04:44 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:04:44 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c3e30f-5e73-4c92-8b34-c4ef2ab80dfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:04:44 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe40917-0b1f-450d-9a5f-9acdfea34554]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571] added
Nov 16 06:04:44 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8c8e29-fe29-402b-b182-8960efea6b9b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f7bea9-2a8b-4319-b0fa-cceb4f459417]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QdHxjwFP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QdHxjwFP" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd96a7d7-3c1d-46a2-92b3-e4e8a042049e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QdHxjwFP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[75791ebe-4307-4bb8-a08c-9ef0dcc0c0a0]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[86398a55-551e-49b2-bb78-a78edb4cf872]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:04:44 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:04:44 user nova-compute[80928]:  {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:04:44 user nova-compute[80928]: WARNING os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 06:04:44 user nova-compute[80928]: 
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[930652dd-bcfc-4d59-b009-6a2fcd54c1d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260]
Nov 16 06:04:44 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260] successful.
Nov 16 06:04:44 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d54ce-6faa-4c1d-a577-cd58d8915bcf]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f84a29b-7040-46e1-9c87-52952acad734]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:04:44 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:04:44 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a6dc59-26cb-4c0d-ad60-6b2776e114b8]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:04:44 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdHxjwFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26339313630616437', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339313630616437', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1325012474',display_name='tempest-TestVolumeBootPattern-server-1325012474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1325012474',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyY8s+sShXfJ+suwop52PyY173m6UiVR4KyrD50QIqQyrl3NE+BGSP1lDWf1O5bcLwC2JeVWfEj32kCuDLGs1JnxJaFNs8IkKGE+tPW/ARVCDA8B+/tdEVqq0AVOypNnA==',key_name='tempest-TestVolumeBootPattern-366323205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-010ha3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:04:39Z,user_data=None,user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=8b807b7a-3f9d-4558-9f1f-51a155d0fe51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:1f:98,bridge_name='br-int',has_traffic_filtering=True,id=f446e49a-0402-478e-94bb-3c2a2dd4b10f,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446e49a-04') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG nova.objects.instance [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b807b7a-3f9d-4558-9f1f-51a155d0fe51 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] End _get_guest_xml xml=<domain type="kvm">
Nov 16 06:04:45 user nova-compute[80928]:   <uuid>8b807b7a-3f9d-4558-9f1f-51a155d0fe51</uuid>
Nov 16 06:04:45 user nova-compute[80928]:   <name>instance-0000002f</name>
Nov 16 06:04:45 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 06:04:45 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 06:04:45 user nova-compute[80928]:   <metadata>
Nov 16 06:04:45 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 06:04:45 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 06:04:45 user nova-compute[80928]:       <nova:name>tempest-TestVolumeBootPattern-server-1325012474</nova:name>
Nov 16 06:04:45 user nova-compute[80928]:       <nova:creationTime>2023-11-16 06:04:44</nova:creationTime>
Nov 16 06:04:45 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 06:04:45 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 06:04:45 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 06:04:45 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 06:04:45 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 06:04:45 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 06:04:45 user nova-compute[80928]:       </nova:flavor>
Nov 16 06:04:45 user nova-compute[80928]:       <nova:owner>
Nov 16 06:04:45 user nova-compute[80928]:         <nova:user uuid="3613cf4088874d1699e1feee5f6edc9f">tempest-TestVolumeBootPattern-315833619-project-member</nova:user>
Nov 16 06:04:45 user nova-compute[80928]:         <nova:project uuid="4b90f29809d44adfb12039c9b7910275">tempest-TestVolumeBootPattern-315833619</nova:project>
Nov 16 06:04:45 user nova-compute[80928]:       </nova:owner>
Nov 16 06:04:45 user nova-compute[80928]:       <nova:ports>
Nov 16 06:04:45 user nova-compute[80928]:         <nova:port uuid="f446e49a-0402-478e-94bb-3c2a2dd4b10f">
Nov 16 06:04:45 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 06:04:45 user nova-compute[80928]:         </nova:port>
Nov 16 06:04:45 user nova-compute[80928]:       </nova:ports>
Nov 16 06:04:45 user nova-compute[80928]:     </nova:instance>
Nov 16 06:04:45 user nova-compute[80928]:   </metadata>
Nov 16 06:04:45 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 06:04:45 user nova-compute[80928]:     <system>
Nov 16 06:04:45 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 06:04:45 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 06:04:45 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 06:04:45 user nova-compute[80928]:       <entry name="serial">8b807b7a-3f9d-4558-9f1f-51a155d0fe51</entry>
Nov 16 06:04:45 user nova-compute[80928]:       <entry name="uuid">8b807b7a-3f9d-4558-9f1f-51a155d0fe51</entry>
Nov 16 06:04:45 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 06:04:45 user nova-compute[80928]:     </system>
Nov 16 06:04:45 user nova-compute[80928]:   </sysinfo>
Nov 16 06:04:45 user nova-compute[80928]:   <os>
Nov 16 06:04:45 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 06:04:45 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 06:04:45 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 06:04:45 user nova-compute[80928]:   </os>
Nov 16 06:04:45 user nova-compute[80928]:   <features>
Nov 16 06:04:45 user nova-compute[80928]:     <acpi/>
Nov 16 06:04:45 user nova-compute[80928]:     <apic/>
Nov 16 06:04:45 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 06:04:45 user nova-compute[80928]:   </features>
Nov 16 06:04:45 user nova-compute[80928]:   <clock offset="utc">
Nov 16 06:04:45 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 06:04:45 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 06:04:45 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 06:04:45 user nova-compute[80928]:   </clock>
Nov 16 06:04:45 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 06:04:45 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 06:04:45 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 06:04:45 user nova-compute[80928]:   </cpu>
Nov 16 06:04:45 user nova-compute[80928]:   <devices>
Nov 16 06:04:45 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 06:04:45 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:04:45 user nova-compute[80928]:       <source dev="/dev/sdb"/>
Nov 16 06:04:45 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 06:04:45 user nova-compute[80928]:       <serial>76a180df-0f5a-4d47-8f96-0a55f560e571</serial>
Nov 16 06:04:45 user nova-compute[80928]:     </disk>
Nov 16 06:04:45 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 06:04:45 user nova-compute[80928]:       <mac address="fa:16:3e:61:1f:98"/>
Nov 16 06:04:45 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:04:45 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 06:04:45 user nova-compute[80928]:       <target dev="tapf446e49a-04"/>
Nov 16 06:04:45 user nova-compute[80928]:     </interface>
Nov 16 06:04:45 user nova-compute[80928]:     <serial type="pty">
Nov 16 06:04:45 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/8b807b7a-3f9d-4558-9f1f-51a155d0fe51/console.log" append="off"/>
Nov 16 06:04:45 user nova-compute[80928]:     </serial>
Nov 16 06:04:45 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 06:04:45 user nova-compute[80928]:     <video>
Nov 16 06:04:45 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:04:45 user nova-compute[80928]:     </video>
Nov 16 06:04:45 user nova-compute[80928]:     <rng model="virtio">
Nov 16 06:04:45 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 06:04:45 user nova-compute[80928]:     </rng>
Nov 16 06:04:45 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 06:04:45 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 06:04:45 user nova-compute[80928]:       <stats period="10"/>
Nov 16 06:04:45 user nova-compute[80928]:     </memballoon>
Nov 16 06:04:45 user nova-compute[80928]:   </devices>
Nov 16 06:04:45 user nova-compute[80928]: </domain>
Nov 16 06:04:45 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1325012474',display_name='tempest-TestVolumeBootPattern-server-1325012474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1325012474',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyY8s+sShXfJ+suwop52PyY173m6UiVR4KyrD50QIqQyrl3NE+BGSP1lDWf1O5bcLwC2JeVWfEj32kCuDLGs1JnxJaFNs8IkKGE+tPW/ARVCDA8B+/tdEVqq0AVOypNnA==',key_name='tempest-TestVolumeBootPattern-366323205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-010ha3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:04:39Z,user_data=None,user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=8b807b7a-3f9d-4558-9f1f-51a155d0fe51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:1f:98,bridge_name='br-int',has_traffic_filtering=True,id=f446e49a-0402-478e-94bb-3c2a2dd4b10f,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446e49a-04') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG os_vif [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:1f:98,bridge_name='br-int',has_traffic_filtering=True,id=f446e49a-0402-478e-94bb-3c2a2dd4b10f,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446e49a-04') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20b94501-2f99-56dc-9bb0-b88b8a99291e', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf446e49a-04, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf446e49a-04, col_values=(('qos', UUID('6dae84f2-41fa-4356-b1f6-5de6e5442ed1')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf446e49a-04, col_values=(('external_ids', {'iface-id': 'f446e49a-0402-478e-94bb-3c2a2dd4b10f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:1f:98', 'vm-uuid': '8b807b7a-3f9d-4558-9f1f-51a155d0fe51'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:45 user nova-compute[80928]: INFO os_vif [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:1f:98,bridge_name='br-int',has_traffic_filtering=True,id=f446e49a-0402-478e-94bb-3c2a2dd4b10f,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446e49a-04')
Nov 16 06:04:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:04:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] No VIF found with MAC fa:16:3e:61:1f:98, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:04:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-5a49702f-b233-47cd-85f0-3fd4cc22e32a req-8a0843c0-4fb8-406f-a22c-74e97d2f95c7 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Received event network-vif-plugged-f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:04:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5a49702f-b233-47cd-85f0-3fd4cc22e32a req-8a0843c0-4fb8-406f-a22c-74e97d2f95c7 service nova] Acquiring lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5a49702f-b233-47cd-85f0-3fd4cc22e32a req-8a0843c0-4fb8-406f-a22c-74e97d2f95c7 service nova] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5a49702f-b233-47cd-85f0-3fd4cc22e32a req-8a0843c0-4fb8-406f-a22c-74e97d2f95c7 service nova] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-5a49702f-b233-47cd-85f0-3fd4cc22e32a req-8a0843c0-4fb8-406f-a22c-74e97d2f95c7 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] No waiting events found dispatching network-vif-plugged-f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:04:46 user nova-compute[80928]: WARNING nova.compute.manager [req-5a49702f-b233-47cd-85f0-3fd4cc22e32a req-8a0843c0-4fb8-406f-a22c-74e97d2f95c7 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Received unexpected event network-vif-plugged-f446e49a-0402-478e-94bb-3c2a2dd4b10f for instance with vm_state building and task_state spawning.
Nov 16 06:04:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 06:04:48 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Instance spawned successfully.
Nov 16 06:04:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-66e02b6b-e975-4cfa-b782-573256d0bf00 req-c6d38c59-2103-40de-858e-07fabd824035 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Received event network-vif-plugged-f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-66e02b6b-e975-4cfa-b782-573256d0bf00 req-c6d38c59-2103-40de-858e-07fabd824035 service nova] Acquiring lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-66e02b6b-e975-4cfa-b782-573256d0bf00 req-c6d38c59-2103-40de-858e-07fabd824035 service nova] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-66e02b6b-e975-4cfa-b782-573256d0bf00 req-c6d38c59-2103-40de-858e-07fabd824035 service nova] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:48 user nova-compute[80928]: DEBUG nova.compute.manager [req-66e02b6b-e975-4cfa-b782-573256d0bf00 req-c6d38c59-2103-40de-858e-07fabd824035 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] No waiting events found dispatching network-vif-plugged-f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:04:48 user nova-compute[80928]: WARNING nova.compute.manager [req-66e02b6b-e975-4cfa-b782-573256d0bf00 req-c6d38c59-2103-40de-858e-07fabd824035 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Received unexpected event network-vif-plugged-f446e49a-0402-478e-94bb-3c2a2dd4b10f for instance with vm_state building and task_state spawning.
Nov 16 06:04:48 user nova-compute[80928]: INFO nova.compute.manager [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 16 06:04:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 06:04:49 user nova-compute[80928]: INFO nova.compute.manager [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Took 10.79 seconds to build instance.
Nov 16 06:04:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-fa7b84b3-ab90-457d-8042-2c18493c002b tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.877s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Verify base images {{(pid=80928) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=80928) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Image id c747fce3-6158-4d78-9cb4-34afacae8f7a yields fingerprint 068709ea92c399b35918a38a3e63ff37e2654176 {{(pid=80928) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 06:04:49 user nova-compute[80928]: INFO nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] image c747fce3-6158-4d78-9cb4-34afacae8f7a at (/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176): checking
Nov 16 06:04:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] image c747fce3-6158-4d78-9cb4-34afacae8f7a at (/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176): image is in use {{(pid=80928) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] d931d111-887d-4a40-835c-4678661d5384 is a valid instance name {{(pid=80928) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] d931d111-887d-4a40-835c-4678661d5384 has a disk file {{(pid=80928) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 16 06:04:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:04:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:04:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance d931d111-887d-4a40-835c-4678661d5384 is backed by 068709ea92c399b35918a38a3e63ff37e2654176 {{(pid=80928) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 16 06:04:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] 8b807b7a-3f9d-4558-9f1f-51a155d0fe51 is a valid instance name {{(pid=80928) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 06:04:50 user nova-compute[80928]: WARNING nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244
Nov 16 06:04:50 user nova-compute[80928]: WARNING nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6
Nov 16 06:04:50 user nova-compute[80928]: WARNING nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Unknown base file: /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9
Nov 16 06:04:50 user nova-compute[80928]: WARNING nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40
Nov 16 06:04:50 user nova-compute[80928]: WARNING nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc
Nov 16 06:04:50 user nova-compute[80928]: WARNING nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Unknown base file: /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6
Nov 16 06:04:50 user nova-compute[80928]: WARNING nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b
Nov 16 06:04:50 user nova-compute[80928]: WARNING nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Unknown base file: /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8
Nov 16 06:04:50 user nova-compute[80928]: WARNING nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Unknown base file: /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a
Nov 16 06:04:50 user nova-compute[80928]: INFO nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Active base files: /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176
Nov 16 06:04:50 user nova-compute[80928]: INFO nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Removable base files: /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244 /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6 /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9 /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40 /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6 /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8 /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a
Nov 16 06:04:50 user nova-compute[80928]: INFO nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2143f93bd2eded617112d9a903bc3f1c96fbf244
Nov 16 06:04:50 user nova-compute[80928]: INFO nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9040b1d08bf293a0a4769f4b2959a8645674d0f6
Nov 16 06:04:50 user nova-compute[80928]: INFO nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/963882eef68b6f42f3caf3eea9ad49d483137ba9
Nov 16 06:04:50 user nova-compute[80928]: INFO nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9d7910dea7bdd8ce24c0f63070c24918cd7e7b40
Nov 16 06:04:50 user nova-compute[80928]: INFO nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dbd8d37617ade4f46eed1833cf1e1dfda5ee41dc
Nov 16 06:04:50 user nova-compute[80928]: INFO nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/faea101239a75d8c49e71e85647c69deacb699a6
Nov 16 06:04:50 user nova-compute[80928]: INFO nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ab391f7fd5f55f0c477a54619642e2ec64c0797b
Nov 16 06:04:50 user nova-compute[80928]: INFO nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/84443267ad32e1c82281ff43616bffc9ffc257e8
Nov 16 06:04:50 user nova-compute[80928]: INFO nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/276e1b96044f056d9abdaf0761a34a51ae5aa73a
Nov 16 06:04:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Verification complete {{(pid=80928) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 16 06:04:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Verify swap images {{(pid=80928) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 16 06:04:50 user nova-compute[80928]: DEBUG nova.virt.libvirt.imagecache [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Verify ephemeral images {{(pid=80928) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 16 06:04:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:04:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:05:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:05:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:05:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:05:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:05:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:05:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:05:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:05:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:05:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:24 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:05:25 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:26 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:05:30 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:05:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:05:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:05:30 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:05:30 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:05:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:05:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:05:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:05:31 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 06:05:31 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:05:31 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:05:31 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=25.258892059326172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:05:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:05:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance d931d111-887d-4a40-835c-4678661d5384 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8b807b7a-3f9d-4558-9f1f-51a155d0fe51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing inventories for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating ProviderTree inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing aggregate associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, aggregates: None {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing trait associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances with incomplete migration  {{(pid=80928) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 06:05:34 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:34 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:05:34 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:05:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-d931d111-887d-4a40-835c-4678661d5384" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:05:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-d931d111-887d-4a40-835c-4678661d5384" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:05:34 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: d931d111-887d-4a40-835c-4678661d5384] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:05:34 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid d931d111-887d-4a40-835c-4678661d5384 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:05:34 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: d931d111-887d-4a40-835c-4678661d5384] Updating instance_info_cache with network_info: [{"id": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "address": "fa:16:3e:ff:86:74", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a4a586-1b", "ovs_interfaceid": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:05:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-d931d111-887d-4a40-835c-4678661d5384" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:05:34 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: d931d111-887d-4a40-835c-4678661d5384] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:05:34 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:05:35 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:35 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:05:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:05:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:05:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:05:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:05:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:05:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 06:05:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] There are 0 instances to clean {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 06:06:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:06:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:06:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "d931d111-887d-4a40-835c-4678661d5384" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "d931d111-887d-4a40-835c-4678661d5384" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "d931d111-887d-4a40-835c-4678661d5384-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "d931d111-887d-4a40-835c-4678661d5384-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "d931d111-887d-4a40-835c-4678661d5384-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:06 user nova-compute[80928]: INFO nova.compute.manager [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Terminating instance
Nov 16 06:06:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:06:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-1a10e54b-3b3d-4cae-9509-be82e32eae39 req-df50fa74-d882-428d-bf7e-8008e6b0e590 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Received event network-vif-unplugged-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1a10e54b-3b3d-4cae-9509-be82e32eae39 req-df50fa74-d882-428d-bf7e-8008e6b0e590 service nova] Acquiring lock "d931d111-887d-4a40-835c-4678661d5384-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1a10e54b-3b3d-4cae-9509-be82e32eae39 req-df50fa74-d882-428d-bf7e-8008e6b0e590 service nova] Lock "d931d111-887d-4a40-835c-4678661d5384-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1a10e54b-3b3d-4cae-9509-be82e32eae39 req-df50fa74-d882-428d-bf7e-8008e6b0e590 service nova] Lock "d931d111-887d-4a40-835c-4678661d5384-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-1a10e54b-3b3d-4cae-9509-be82e32eae39 req-df50fa74-d882-428d-bf7e-8008e6b0e590 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] No waiting events found dispatching network-vif-unplugged-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-1a10e54b-3b3d-4cae-9509-be82e32eae39 req-df50fa74-d882-428d-bf7e-8008e6b0e590 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Received event network-vif-unplugged-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: d931d111-887d-4a40-835c-4678661d5384] Instance destroyed successfully.
Nov 16 06:06:07 user nova-compute[80928]: DEBUG nova.objects.instance [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lazy-loading 'resources' on Instance uuid d931d111-887d-4a40-835c-4678661d5384 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1105563011',display_name='tempest-VolumesActionsTest-instance-1105563011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1105563011',id=46,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T06:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc3ac7d0f0bd4e60b5ea5403820f1dba',ramdisk_id='',reservation_id='r-00s2px8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-429150892',owner_user_name='tempest-VolumesActionsTest-429150892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T06:04:23Z,user_data=None,user_id='56314c196f8c49eca27951f9bb8fcd57',uuid=d931d111-887d-4a40-835c-4678661d5384,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "address": "fa:16:3e:ff:86:74", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a4a586-1b", "ovs_interfaceid": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Converting VIF {"id": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "address": "fa:16:3e:ff:86:74", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a4a586-1b", "ovs_interfaceid": "f4a4a586-1b38-4f42-8106-2fc2ab4588f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:86:74,bridge_name='br-int',has_traffic_filtering=True,id=f4a4a586-1b38-4f42-8106-2fc2ab4588f7,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a4a586-1b') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG os_vif [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:86:74,bridge_name='br-int',has_traffic_filtering=True,id=f4a4a586-1b38-4f42-8106-2fc2ab4588f7,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a4a586-1b') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4a4a586-1b, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cbf1591-16db-460c-9613-34483b7df16b) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:07 user nova-compute[80928]: INFO os_vif [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:86:74,bridge_name='br-int',has_traffic_filtering=True,id=f4a4a586-1b38-4f42-8106-2fc2ab4588f7,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a4a586-1b')
Nov 16 06:06:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Deleting instance files /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384_del
Nov 16 06:06:07 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Deletion of /opt/stack/data/nova/instances/d931d111-887d-4a40-835c-4678661d5384_del complete
Nov 16 06:06:07 user nova-compute[80928]: INFO nova.compute.manager [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: d931d111-887d-4a40-835c-4678661d5384] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 06:06:07 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: d931d111-887d-4a40-835c-4678661d5384] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:06:07 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: d931d111-887d-4a40-835c-4678661d5384] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:06:08 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: d931d111-887d-4a40-835c-4678661d5384] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:06:08 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: d931d111-887d-4a40-835c-4678661d5384] Took 0.46 seconds to deallocate network for instance.
Nov 16 06:06:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:08 user nova-compute[80928]: DEBUG nova.compute.manager [req-a42d1f81-688c-412f-9b61-7aa389eadc22 req-d3df0c61-f6c8-43aa-abac-9e85d31c7cdd service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Received event network-vif-deleted-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:06:08 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:06:08 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:06:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:08 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Deleted allocations for instance d931d111-887d-4a40-835c-4678661d5384
Nov 16 06:06:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45648cd6-7ad3-42d4-8f34-115a1941ee04 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "d931d111-887d-4a40-835c-4678661d5384" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.661s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-083c561f-9fbb-4a42-8626-111fe0eb141c req-fe75b778-79c8-48da-9dfe-6aba9321d2c8 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Received event network-vif-plugged-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:06:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-083c561f-9fbb-4a42-8626-111fe0eb141c req-fe75b778-79c8-48da-9dfe-6aba9321d2c8 service nova] Acquiring lock "d931d111-887d-4a40-835c-4678661d5384-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-083c561f-9fbb-4a42-8626-111fe0eb141c req-fe75b778-79c8-48da-9dfe-6aba9321d2c8 service nova] Lock "d931d111-887d-4a40-835c-4678661d5384-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-083c561f-9fbb-4a42-8626-111fe0eb141c req-fe75b778-79c8-48da-9dfe-6aba9321d2c8 service nova] Lock "d931d111-887d-4a40-835c-4678661d5384-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-083c561f-9fbb-4a42-8626-111fe0eb141c req-fe75b778-79c8-48da-9dfe-6aba9321d2c8 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] No waiting events found dispatching network-vif-plugged-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:06:09 user nova-compute[80928]: WARNING nova.compute.manager [req-083c561f-9fbb-4a42-8626-111fe0eb141c req-fe75b778-79c8-48da-9dfe-6aba9321d2c8 service nova] [instance: d931d111-887d-4a40-835c-4678661d5384] Received unexpected event network-vif-plugged-f4a4a586-1b38-4f42-8106-2fc2ab4588f7 for instance with vm_state deleted and task_state None.
Nov 16 06:06:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:06:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:06:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:06:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:06:26 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:06:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:06:27 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:06:27 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_power_states {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:06:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid 8b807b7a-3f9d-4558-9f1f-51a155d0fe51 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 06:06:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-aed45c6e-aeb1-408b-90b2-b1689abcd848 req-af7b039c-fb26-439e-bcf2-b3e4e70de3b8 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Received event network-changed-f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:06:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-aed45c6e-aeb1-408b-90b2-b1689abcd848 req-af7b039c-fb26-439e-bcf2-b3e4e70de3b8 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Refreshing instance network info cache due to event network-changed-f446e49a-0402-478e-94bb-3c2a2dd4b10f. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:06:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aed45c6e-aeb1-408b-90b2-b1689abcd848 req-af7b039c-fb26-439e-bcf2-b3e4e70de3b8 service nova] Acquiring lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:06:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aed45c6e-aeb1-408b-90b2-b1689abcd848 req-af7b039c-fb26-439e-bcf2-b3e4e70de3b8 service nova] Acquired lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:06:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-aed45c6e-aeb1-408b-90b2-b1689abcd848 req-af7b039c-fb26-439e-bcf2-b3e4e70de3b8 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Refreshing network info cache for port f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:06:30 user nova-compute[80928]: DEBUG nova.network.neutron [req-aed45c6e-aeb1-408b-90b2-b1689abcd848 req-af7b039c-fb26-439e-bcf2-b3e4e70de3b8 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updated VIF entry in instance network info cache for port f446e49a-0402-478e-94bb-3c2a2dd4b10f. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:06:30 user nova-compute[80928]: DEBUG nova.network.neutron [req-aed45c6e-aeb1-408b-90b2-b1689abcd848 req-af7b039c-fb26-439e-bcf2-b3e4e70de3b8 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updating instance_info_cache with network_info: [{"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:06:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-aed45c6e-aeb1-408b-90b2-b1689abcd848 req-af7b039c-fb26-439e-bcf2-b3e4e70de3b8 service nova] Releasing lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:06:30 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:06:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:30 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:06:30 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 06:06:31 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:06:31 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:06:31 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8932MB free_disk=25.278133392333984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:06:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:31 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8b807b7a-3f9d-4558-9f1f-51a155d0fe51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:06:31 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:06:31 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:06:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:31 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:06:31 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:06:31 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:06:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:34 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:06:34 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:06:34 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:06:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:06:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:06:34 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "ee65f4e3-82cf-4d46-a787-538119b9a013" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updating instance_info_cache with network_info: [{"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 06:06:35 user nova-compute[80928]: INFO nova.compute.claims [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Claim successful on node user
Nov 16 06:06:35 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 06:06:35 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 06:06:35 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG nova.policy [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3613cf4088874d1699e1feee5f6edc9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90f29809d44adfb12039c9b7910275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 06:06:35 user nova-compute[80928]: INFO nova.virt.block_device [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Booting with volume e9aba436-d60d-428b-ada1-ded1958fc190 at /dev/vda
Nov 16 06:06:35 user nova-compute[80928]: DEBUG os_brick.utils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6945c097-603a-4a7c-9f74-1ebfa8c2531e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32b4b3d-3199-48d3-8fd4-783970fd5f85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d4bcd5-eb9f-4065-addc-3409ef834133]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[247bf55b-718e-4aef-8c9e-8302fa36058d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:06:35 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:06:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dea0bdf-52b4-4c4a-a096-2fb98b34c1a8]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG os_brick.utils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:06:35 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Updating existing volume attachment record: 96d10e42-c791-4d05-aae5-c8ccad0ccefe {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:06:36 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Successfully created port: 5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 06:06:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Successfully updated port: 5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "refresh_cache-ee65f4e3-82cf-4d46-a787-538119b9a013" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquired lock "refresh_cache-ee65f4e3-82cf-4d46-a787-538119b9a013" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG nova.compute.manager [req-b8894581-d170-49de-946c-85c7db69d2c2 req-8535745f-742e-41ff-ab16-7db699e26832 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Received event network-changed-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG nova.compute.manager [req-b8894581-d170-49de-946c-85c7db69d2c2 req-8535745f-742e-41ff-ab16-7db699e26832 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Refreshing instance network info cache due to event network-changed-5d5684fc-a66d-4cc5-b62b-6f3ef7144033. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b8894581-d170-49de-946c-85c7db69d2c2 req-8535745f-742e-41ff-ab16-7db699e26832 service nova] Acquiring lock "refresh_cache-ee65f4e3-82cf-4d46-a787-538119b9a013" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG nova.network.neutron [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Updating instance_info_cache with network_info: [{"id": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "address": "fa:16:3e:76:38:01", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5684fc-a6", "ovs_interfaceid": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Releasing lock "refresh_cache-ee65f4e3-82cf-4d46-a787-538119b9a013" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Instance network_info: |[{"id": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "address": "fa:16:3e:76:38:01", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5684fc-a6", "ovs_interfaceid": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b8894581-d170-49de-946c-85c7db69d2c2 req-8535745f-742e-41ff-ab16-7db699e26832 service nova] Acquired lock "refresh_cache-ee65f4e3-82cf-4d46-a787-538119b9a013" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG nova.network.neutron [req-b8894581-d170-49de-946c-85c7db69d2c2 req-8535745f-742e-41ff-ab16-7db699e26832 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Refreshing network info cache for port 5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG nova.network.neutron [req-b8894581-d170-49de-946c-85c7db69d2c2 req-8535745f-742e-41ff-ab16-7db699e26832 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Updated VIF entry in instance network info cache for port 5d5684fc-a66d-4cc5-b62b-6f3ef7144033. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG nova.network.neutron [req-b8894581-d170-49de-946c-85c7db69d2c2 req-8535745f-742e-41ff-ab16-7db699e26832 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Updating instance_info_cache with network_info: [{"id": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "address": "fa:16:3e:76:38:01", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5684fc-a6", "ovs_interfaceid": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:06:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b8894581-d170-49de-946c-85c7db69d2c2 req-8535745f-742e-41ff-ab16-7db699e26832 service nova] Releasing lock "refresh_cache-ee65f4e3-82cf-4d46-a787-538119b9a013" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 06:06:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Creating image(s)
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Did not create local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Ensure instance console log exists: /opt/stack/data/nova/instances/ee65f4e3-82cf-4d46-a787-538119b9a013/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Start _get_guest_xml network_info=[{"id": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "address": "fa:16:3e:76:38:01", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5684fc-a6", "ovs_interfaceid": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgTfAhQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee65f4e3-82cf-4d46-a787-538119b9a013', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9aba436-d60d-428b-ada1-ded1958fc190', 'serial': 'e9aba436-d60d-428b-ada1-ded1958fc190'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '96d10e42-c791-4d05-aae5-c8ccad0ccefe', 'volume_type': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 06:06:40 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:06:40 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgTfAhQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:06:40 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:06:40 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:06:40 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef64203-ed94-4ba9-b3f0-cc703ef2827c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:06:40 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf906332-d304-4400-bb64-ab16becd5e7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190] added
Nov 16 06:06:40 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bd264f-b498-4e5b-90cd-4c5809574041]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26fc770-6e69-4fa5-94e7-81fb4218d38b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NgTfAhQI {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NgTfAhQI" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bfd2d7-fe02-4a96-b09d-65462a1e7d25]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NgTfAhQI'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[44526175-da6b-47c2-be18-49d1ffc0ad8a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2b4e14-e51b-4acc-b1be-0913610bb031]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:06:40 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:06:40 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:06:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[235ce531-1547-4b78-8959-c9bc6b48a1d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190, portal: 172.16.0.220,3260]
Nov 16 06:06:41 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190, portal: 172.16.0.220,3260] successful.
Nov 16 06:06:41 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c11143a-6ece-4ddd-b73e-28b80b5e7c18]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc566171-236b-4714-8afb-940728c50b60]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:06:41 user nova-compute[80928]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 (non-flash)
Nov 16 06:06:41 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:06:41 user nova-compute[80928]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 (non-flash)
Nov 16 06:06:41 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5114e8-81fe-4867-a41a-798ae1646eff]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgTfAhQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:06:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23735646633373365', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735646633373365', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-975782824',display_name='tempest-TestVolumeBootPattern-server-975782824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-975782824',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyY8s+sShXfJ+suwop52PyY173m6UiVR4KyrD50QIqQyrl3NE+BGSP1lDWf1O5bcLwC2JeVWfEj32kCuDLGs1JnxJaFNs8IkKGE+tPW/ARVCDA8B+/tdEVqq0AVOypNnA==',key_name='tempest-TestVolumeBootPattern-366323205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-j9e85eyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:06:36Z,user_data=None,user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=ee65f4e3-82cf-4d46-a787-538119b9a013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "address": "fa:16:3e:76:38:01", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5684fc-a6", "ovs_interfaceid": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "address": "fa:16:3e:76:38:01", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5684fc-a6", "ovs_interfaceid": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:38:01,bridge_name='br-int',has_traffic_filtering=True,id=5d5684fc-a66d-4cc5-b62b-6f3ef7144033,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5684fc-a6') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lazy-loading 'pci_devices' on Instance uuid ee65f4e3-82cf-4d46-a787-538119b9a013 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] End _get_guest_xml xml=<domain type="kvm">
Nov 16 06:06:42 user nova-compute[80928]:   <uuid>ee65f4e3-82cf-4d46-a787-538119b9a013</uuid>
Nov 16 06:06:42 user nova-compute[80928]:   <name>instance-00000030</name>
Nov 16 06:06:42 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 06:06:42 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 06:06:42 user nova-compute[80928]:   <metadata>
Nov 16 06:06:42 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 06:06:42 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 06:06:42 user nova-compute[80928]:       <nova:name>tempest-TestVolumeBootPattern-server-975782824</nova:name>
Nov 16 06:06:42 user nova-compute[80928]:       <nova:creationTime>2023-11-16 06:06:40</nova:creationTime>
Nov 16 06:06:42 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 06:06:42 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 06:06:42 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 06:06:42 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 06:06:42 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 06:06:42 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 06:06:42 user nova-compute[80928]:       </nova:flavor>
Nov 16 06:06:42 user nova-compute[80928]:       <nova:owner>
Nov 16 06:06:42 user nova-compute[80928]:         <nova:user uuid="3613cf4088874d1699e1feee5f6edc9f">tempest-TestVolumeBootPattern-315833619-project-member</nova:user>
Nov 16 06:06:42 user nova-compute[80928]:         <nova:project uuid="4b90f29809d44adfb12039c9b7910275">tempest-TestVolumeBootPattern-315833619</nova:project>
Nov 16 06:06:42 user nova-compute[80928]:       </nova:owner>
Nov 16 06:06:42 user nova-compute[80928]:       <nova:ports>
Nov 16 06:06:42 user nova-compute[80928]:         <nova:port uuid="5d5684fc-a66d-4cc5-b62b-6f3ef7144033">
Nov 16 06:06:42 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 06:06:42 user nova-compute[80928]:         </nova:port>
Nov 16 06:06:42 user nova-compute[80928]:       </nova:ports>
Nov 16 06:06:42 user nova-compute[80928]:     </nova:instance>
Nov 16 06:06:42 user nova-compute[80928]:   </metadata>
Nov 16 06:06:42 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 06:06:42 user nova-compute[80928]:     <system>
Nov 16 06:06:42 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 06:06:42 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 06:06:42 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 06:06:42 user nova-compute[80928]:       <entry name="serial">ee65f4e3-82cf-4d46-a787-538119b9a013</entry>
Nov 16 06:06:42 user nova-compute[80928]:       <entry name="uuid">ee65f4e3-82cf-4d46-a787-538119b9a013</entry>
Nov 16 06:06:42 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 06:06:42 user nova-compute[80928]:     </system>
Nov 16 06:06:42 user nova-compute[80928]:   </sysinfo>
Nov 16 06:06:42 user nova-compute[80928]:   <os>
Nov 16 06:06:42 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 06:06:42 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 06:06:42 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 06:06:42 user nova-compute[80928]:   </os>
Nov 16 06:06:42 user nova-compute[80928]:   <features>
Nov 16 06:06:42 user nova-compute[80928]:     <acpi/>
Nov 16 06:06:42 user nova-compute[80928]:     <apic/>
Nov 16 06:06:42 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 06:06:42 user nova-compute[80928]:   </features>
Nov 16 06:06:42 user nova-compute[80928]:   <clock offset="utc">
Nov 16 06:06:42 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 06:06:42 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 06:06:42 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 06:06:42 user nova-compute[80928]:   </clock>
Nov 16 06:06:42 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 06:06:42 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 06:06:42 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 06:06:42 user nova-compute[80928]:   </cpu>
Nov 16 06:06:42 user nova-compute[80928]:   <devices>
Nov 16 06:06:42 user nova-compute[80928]:     <disk type="block" device="disk">
Nov 16 06:06:42 user nova-compute[80928]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:06:42 user nova-compute[80928]:       <source dev="/dev/sdc"/>
Nov 16 06:06:42 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 06:06:42 user nova-compute[80928]:       <serial>e9aba436-d60d-428b-ada1-ded1958fc190</serial>
Nov 16 06:06:42 user nova-compute[80928]:     </disk>
Nov 16 06:06:42 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 06:06:42 user nova-compute[80928]:       <mac address="fa:16:3e:76:38:01"/>
Nov 16 06:06:42 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:06:42 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 06:06:42 user nova-compute[80928]:       <target dev="tap5d5684fc-a6"/>
Nov 16 06:06:42 user nova-compute[80928]:     </interface>
Nov 16 06:06:42 user nova-compute[80928]:     <serial type="pty">
Nov 16 06:06:42 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/ee65f4e3-82cf-4d46-a787-538119b9a013/console.log" append="off"/>
Nov 16 06:06:42 user nova-compute[80928]:     </serial>
Nov 16 06:06:42 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 06:06:42 user nova-compute[80928]:     <video>
Nov 16 06:06:42 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:06:42 user nova-compute[80928]:     </video>
Nov 16 06:06:42 user nova-compute[80928]:     <rng model="virtio">
Nov 16 06:06:42 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 06:06:42 user nova-compute[80928]:     </rng>
Nov 16 06:06:42 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 06:06:42 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 06:06:42 user nova-compute[80928]:       <stats period="10"/>
Nov 16 06:06:42 user nova-compute[80928]:     </memballoon>
Nov 16 06:06:42 user nova-compute[80928]:   </devices>
Nov 16 06:06:42 user nova-compute[80928]: </domain>
Nov 16 06:06:42 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-975782824',display_name='tempest-TestVolumeBootPattern-server-975782824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-975782824',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyY8s+sShXfJ+suwop52PyY173m6UiVR4KyrD50QIqQyrl3NE+BGSP1lDWf1O5bcLwC2JeVWfEj32kCuDLGs1JnxJaFNs8IkKGE+tPW/ARVCDA8B+/tdEVqq0AVOypNnA==',key_name='tempest-TestVolumeBootPattern-366323205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-j9e85eyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:06:36Z,user_data=None,user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=ee65f4e3-82cf-4d46-a787-538119b9a013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "address": "fa:16:3e:76:38:01", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5684fc-a6", "ovs_interfaceid": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "address": "fa:16:3e:76:38:01", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5684fc-a6", "ovs_interfaceid": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:38:01,bridge_name='br-int',has_traffic_filtering=True,id=5d5684fc-a66d-4cc5-b62b-6f3ef7144033,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5684fc-a6') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG os_vif [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:38:01,bridge_name='br-int',has_traffic_filtering=True,id=5d5684fc-a66d-4cc5-b62b-6f3ef7144033,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5684fc-a6') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc6eed73-8fdc-5223-8e63-6caf40e68071', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d5684fc-a6, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d5684fc-a6, col_values=(('qos', UUID('875e1c4a-3fcb-4ddc-aa1f-44e48582bc55')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d5684fc-a6, col_values=(('external_ids', {'iface-id': '5d5684fc-a66d-4cc5-b62b-6f3ef7144033', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:38:01', 'vm-uuid': 'ee65f4e3-82cf-4d46-a787-538119b9a013'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:42 user nova-compute[80928]: INFO os_vif [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:38:01,bridge_name='br-int',has_traffic_filtering=True,id=5d5684fc-a66d-4cc5-b62b-6f3ef7144033,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5684fc-a6')
Nov 16 06:06:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:06:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] No VIF found with MAC fa:16:3e:76:38:01, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:06:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:43 user nova-compute[80928]: DEBUG nova.compute.manager [req-c17a2c3b-a096-4408-a623-a49388197fcc req-b683a425-fdd3-40ca-9451-d8404e8300c3 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Received event network-vif-plugged-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:06:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c17a2c3b-a096-4408-a623-a49388197fcc req-b683a425-fdd3-40ca-9451-d8404e8300c3 service nova] Acquiring lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c17a2c3b-a096-4408-a623-a49388197fcc req-b683a425-fdd3-40ca-9451-d8404e8300c3 service nova] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c17a2c3b-a096-4408-a623-a49388197fcc req-b683a425-fdd3-40ca-9451-d8404e8300c3 service nova] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:43 user nova-compute[80928]: DEBUG nova.compute.manager [req-c17a2c3b-a096-4408-a623-a49388197fcc req-b683a425-fdd3-40ca-9451-d8404e8300c3 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] No waiting events found dispatching network-vif-plugged-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:06:43 user nova-compute[80928]: WARNING nova.compute.manager [req-c17a2c3b-a096-4408-a623-a49388197fcc req-b683a425-fdd3-40ca-9451-d8404e8300c3 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Received unexpected event network-vif-plugged-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 for instance with vm_state building and task_state spawning.
Nov 16 06:06:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:45 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 06:06:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 06:06:45 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Instance spawned successfully.
Nov 16 06:06:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 06:06:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:06:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:06:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:06:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:06:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:06:45 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:06:45 user nova-compute[80928]: INFO nova.compute.manager [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Took 4.85 seconds to spawn the instance on the hypervisor.
Nov 16 06:06:45 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 06:06:45 user nova-compute[80928]: INFO nova.compute.manager [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Took 10.37 seconds to build instance.
Nov 16 06:06:45 user nova-compute[80928]: DEBUG nova.compute.manager [req-7d07a0f3-f631-4b94-a870-7fbde820ffac req-e5c894f8-290c-4ae9-9e5a-a2ef5ef6396f service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Received event network-vif-plugged-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:06:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7d07a0f3-f631-4b94-a870-7fbde820ffac req-e5c894f8-290c-4ae9-9e5a-a2ef5ef6396f service nova] Acquiring lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7d07a0f3-f631-4b94-a870-7fbde820ffac req-e5c894f8-290c-4ae9-9e5a-a2ef5ef6396f service nova] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-7d07a0f3-f631-4b94-a870-7fbde820ffac req-e5c894f8-290c-4ae9-9e5a-a2ef5ef6396f service nova] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:45 user nova-compute[80928]: DEBUG nova.compute.manager [req-7d07a0f3-f631-4b94-a870-7fbde820ffac req-e5c894f8-290c-4ae9-9e5a-a2ef5ef6396f service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] No waiting events found dispatching network-vif-plugged-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:06:45 user nova-compute[80928]: WARNING nova.compute.manager [req-7d07a0f3-f631-4b94-a870-7fbde820ffac req-e5c894f8-290c-4ae9-9e5a-a2ef5ef6396f service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Received unexpected event network-vif-plugged-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 for instance with vm_state active and task_state None.
Nov 16 06:06:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7daa35c9-fe26-49b3-94eb-664ab6d28744 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.472s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:06:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:06:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:06:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:06:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "91932678-3ff4-40da-9900-b51c6f824404" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "91932678-3ff4-40da-9900-b51c6f824404" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 06:06:58 user nova-compute[80928]: INFO nova.compute.claims [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Claim successful on node user
Nov 16 06:06:58 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 06:06:58 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 06:06:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG nova.policy [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56314c196f8c49eca27951f9bb8fcd57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3ac7d0f0bd4e60b5ea5403820f1dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 06:06:58 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Creating image(s)
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "/opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "/opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "/opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.072s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.193s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Successfully created port: fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk 1073741824" returned: 0 in 0.055s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.194s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Cannot resize image /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Ensure instance console log exists: /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Successfully updated port: fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "refresh_cache-91932678-3ff4-40da-9900-b51c6f824404" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquired lock "refresh_cache-91932678-3ff4-40da-9900-b51c6f824404" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-33221eeb-686b-434d-af36-57e8c173d298 req-fe61ae23-7161-47d5-b555-3944ddaea734 service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Received event network-changed-fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-33221eeb-686b-434d-af36-57e8c173d298 req-fe61ae23-7161-47d5-b555-3944ddaea734 service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Refreshing instance network info cache due to event network-changed-fa778f4b-755c-4c9d-94f0-15b57ebca609. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-33221eeb-686b-434d-af36-57e8c173d298 req-fe61ae23-7161-47d5-b555-3944ddaea734 service nova] Acquiring lock "refresh_cache-91932678-3ff4-40da-9900-b51c6f824404" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:06:59 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Updating instance_info_cache with network_info: [{"id": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "address": "fa:16:3e:79:34:92", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa778f4b-75", "ovs_interfaceid": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Releasing lock "refresh_cache-91932678-3ff4-40da-9900-b51c6f824404" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Instance network_info: |[{"id": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "address": "fa:16:3e:79:34:92", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa778f4b-75", "ovs_interfaceid": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-33221eeb-686b-434d-af36-57e8c173d298 req-fe61ae23-7161-47d5-b555-3944ddaea734 service nova] Acquired lock "refresh_cache-91932678-3ff4-40da-9900-b51c6f824404" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.network.neutron [req-33221eeb-686b-434d-af36-57e8c173d298 req-fe61ae23-7161-47d5-b555-3944ddaea734 service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Refreshing network info cache for port fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Start _get_guest_xml network_info=[{"id": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "address": "fa:16:3e:79:34:92", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa778f4b-75", "ovs_interfaceid": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 06:07:00 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:07:00 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1848710911',display_name='tempest-VolumesActionsTest-instance-1848710911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1848710911',id=49,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc3ac7d0f0bd4e60b5ea5403820f1dba',ramdisk_id='',reservation_id='r-yd4j09dn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-429150892',owner_user_name='tempest-VolumesActionsTest-429150892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:06:59Z,user_data=None,user_id='56314c196f8c49eca27951f9bb8fcd57',uuid=91932678-3ff4-40da-9900-b51c6f824404,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "address": "fa:16:3e:79:34:92", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa778f4b-75", "ovs_interfaceid": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Converting VIF {"id": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "address": "fa:16:3e:79:34:92", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa778f4b-75", "ovs_interfaceid": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:92,bridge_name='br-int',has_traffic_filtering=True,id=fa778f4b-755c-4c9d-94f0-15b57ebca609,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa778f4b-75') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lazy-loading 'pci_devices' on Instance uuid 91932678-3ff4-40da-9900-b51c6f824404 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] End _get_guest_xml xml=<domain type="kvm">
Nov 16 06:07:00 user nova-compute[80928]:   <uuid>91932678-3ff4-40da-9900-b51c6f824404</uuid>
Nov 16 06:07:00 user nova-compute[80928]:   <name>instance-00000031</name>
Nov 16 06:07:00 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 06:07:00 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 06:07:00 user nova-compute[80928]:   <metadata>
Nov 16 06:07:00 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 06:07:00 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 06:07:00 user nova-compute[80928]:       <nova:name>tempest-VolumesActionsTest-instance-1848710911</nova:name>
Nov 16 06:07:00 user nova-compute[80928]:       <nova:creationTime>2023-11-16 06:07:00</nova:creationTime>
Nov 16 06:07:00 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 06:07:00 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 06:07:00 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 06:07:00 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 06:07:00 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 06:07:00 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 06:07:00 user nova-compute[80928]:       </nova:flavor>
Nov 16 06:07:00 user nova-compute[80928]:       <nova:owner>
Nov 16 06:07:00 user nova-compute[80928]:         <nova:user uuid="56314c196f8c49eca27951f9bb8fcd57">tempest-VolumesActionsTest-429150892-project-member</nova:user>
Nov 16 06:07:00 user nova-compute[80928]:         <nova:project uuid="cc3ac7d0f0bd4e60b5ea5403820f1dba">tempest-VolumesActionsTest-429150892</nova:project>
Nov 16 06:07:00 user nova-compute[80928]:       </nova:owner>
Nov 16 06:07:00 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 06:07:00 user nova-compute[80928]:       <nova:ports>
Nov 16 06:07:00 user nova-compute[80928]:         <nova:port uuid="fa778f4b-755c-4c9d-94f0-15b57ebca609">
Nov 16 06:07:00 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 06:07:00 user nova-compute[80928]:         </nova:port>
Nov 16 06:07:00 user nova-compute[80928]:       </nova:ports>
Nov 16 06:07:00 user nova-compute[80928]:     </nova:instance>
Nov 16 06:07:00 user nova-compute[80928]:   </metadata>
Nov 16 06:07:00 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 06:07:00 user nova-compute[80928]:     <system>
Nov 16 06:07:00 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 06:07:00 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 06:07:00 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 06:07:00 user nova-compute[80928]:       <entry name="serial">91932678-3ff4-40da-9900-b51c6f824404</entry>
Nov 16 06:07:00 user nova-compute[80928]:       <entry name="uuid">91932678-3ff4-40da-9900-b51c6f824404</entry>
Nov 16 06:07:00 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 06:07:00 user nova-compute[80928]:     </system>
Nov 16 06:07:00 user nova-compute[80928]:   </sysinfo>
Nov 16 06:07:00 user nova-compute[80928]:   <os>
Nov 16 06:07:00 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 06:07:00 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 06:07:00 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 06:07:00 user nova-compute[80928]:   </os>
Nov 16 06:07:00 user nova-compute[80928]:   <features>
Nov 16 06:07:00 user nova-compute[80928]:     <acpi/>
Nov 16 06:07:00 user nova-compute[80928]:     <apic/>
Nov 16 06:07:00 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 06:07:00 user nova-compute[80928]:   </features>
Nov 16 06:07:00 user nova-compute[80928]:   <clock offset="utc">
Nov 16 06:07:00 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 06:07:00 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 06:07:00 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 06:07:00 user nova-compute[80928]:   </clock>
Nov 16 06:07:00 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 06:07:00 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 06:07:00 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 06:07:00 user nova-compute[80928]:   </cpu>
Nov 16 06:07:00 user nova-compute[80928]:   <devices>
Nov 16 06:07:00 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 06:07:00 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 06:07:00 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk"/>
Nov 16 06:07:00 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 06:07:00 user nova-compute[80928]:     </disk>
Nov 16 06:07:00 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 06:07:00 user nova-compute[80928]:       <mac address="fa:16:3e:79:34:92"/>
Nov 16 06:07:00 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:07:00 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 06:07:00 user nova-compute[80928]:       <target dev="tapfa778f4b-75"/>
Nov 16 06:07:00 user nova-compute[80928]:     </interface>
Nov 16 06:07:00 user nova-compute[80928]:     <serial type="pty">
Nov 16 06:07:00 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/console.log" append="off"/>
Nov 16 06:07:00 user nova-compute[80928]:     </serial>
Nov 16 06:07:00 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 06:07:00 user nova-compute[80928]:     <video>
Nov 16 06:07:00 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:07:00 user nova-compute[80928]:     </video>
Nov 16 06:07:00 user nova-compute[80928]:     <rng model="virtio">
Nov 16 06:07:00 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 06:07:00 user nova-compute[80928]:     </rng>
Nov 16 06:07:00 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 06:07:00 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 06:07:00 user nova-compute[80928]:       <stats period="10"/>
Nov 16 06:07:00 user nova-compute[80928]:     </memballoon>
Nov 16 06:07:00 user nova-compute[80928]:   </devices>
Nov 16 06:07:00 user nova-compute[80928]: </domain>
Nov 16 06:07:00 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1848710911',display_name='tempest-VolumesActionsTest-instance-1848710911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1848710911',id=49,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc3ac7d0f0bd4e60b5ea5403820f1dba',ramdisk_id='',reservation_id='r-yd4j09dn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-429150892',owner_user_name='tempest-VolumesActionsTest-429150892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:06:59Z,user_data=None,user_id='56314c196f8c49eca27951f9bb8fcd57',uuid=91932678-3ff4-40da-9900-b51c6f824404,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "address": "fa:16:3e:79:34:92", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa778f4b-75", "ovs_interfaceid": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Converting VIF {"id": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "address": "fa:16:3e:79:34:92", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa778f4b-75", "ovs_interfaceid": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:92,bridge_name='br-int',has_traffic_filtering=True,id=fa778f4b-755c-4c9d-94f0-15b57ebca609,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa778f4b-75') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG os_vif [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:92,bridge_name='br-int',has_traffic_filtering=True,id=fa778f4b-755c-4c9d-94f0-15b57ebca609,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa778f4b-75') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9124e56-f1d3-56a9-9044-a0035788f0c7', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa778f4b-75, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa778f4b-75, col_values=(('qos', UUID('2af8d62b-3e89-46bc-ac48-a9e16efcd4d6')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa778f4b-75, col_values=(('external_ids', {'iface-id': 'fa778f4b-755c-4c9d-94f0-15b57ebca609', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:34:92', 'vm-uuid': '91932678-3ff4-40da-9900-b51c6f824404'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:00 user nova-compute[80928]: INFO os_vif [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:34:92,bridge_name='br-int',has_traffic_filtering=True,id=fa778f4b-755c-4c9d-94f0-15b57ebca609,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa778f4b-75')
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] No VIF found with MAC fa:16:3e:79:34:92, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.network.neutron [req-33221eeb-686b-434d-af36-57e8c173d298 req-fe61ae23-7161-47d5-b555-3944ddaea734 service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Updated VIF entry in instance network info cache for port fa778f4b-755c-4c9d-94f0-15b57ebca609. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG nova.network.neutron [req-33221eeb-686b-434d-af36-57e8c173d298 req-fe61ae23-7161-47d5-b555-3944ddaea734 service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Updating instance_info_cache with network_info: [{"id": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "address": "fa:16:3e:79:34:92", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa778f4b-75", "ovs_interfaceid": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:07:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-33221eeb-686b-434d-af36-57e8c173d298 req-fe61ae23-7161-47d5-b555-3944ddaea734 service nova] Releasing lock "refresh_cache-91932678-3ff4-40da-9900-b51c6f824404" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:07:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-4cd92d65-e342-4149-8c07-81ffc0d5a1ea req-f0e3a16a-e6df-4b3e-9786-9f0335c12e7d service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Received event network-vif-plugged-fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:07:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4cd92d65-e342-4149-8c07-81ffc0d5a1ea req-f0e3a16a-e6df-4b3e-9786-9f0335c12e7d service nova] Acquiring lock "91932678-3ff4-40da-9900-b51c6f824404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:07:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4cd92d65-e342-4149-8c07-81ffc0d5a1ea req-f0e3a16a-e6df-4b3e-9786-9f0335c12e7d service nova] Lock "91932678-3ff4-40da-9900-b51c6f824404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:07:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4cd92d65-e342-4149-8c07-81ffc0d5a1ea req-f0e3a16a-e6df-4b3e-9786-9f0335c12e7d service nova] Lock "91932678-3ff4-40da-9900-b51c6f824404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:07:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-4cd92d65-e342-4149-8c07-81ffc0d5a1ea req-f0e3a16a-e6df-4b3e-9786-9f0335c12e7d service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] No waiting events found dispatching network-vif-plugged-fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:07:01 user nova-compute[80928]: WARNING nova.compute.manager [req-4cd92d65-e342-4149-8c07-81ffc0d5a1ea req-f0e3a16a-e6df-4b3e-9786-9f0335c12e7d service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Received unexpected event network-vif-plugged-fa778f4b-755c-4c9d-94f0-15b57ebca609 for instance with vm_state building and task_state spawning.
Nov 16 06:07:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 06:07:03 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Instance spawned successfully.
Nov 16 06:07:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:07:03 user nova-compute[80928]: INFO nova.compute.manager [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 16 06:07:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-b346f962-43bc-4a7d-874c-4c609941d257 req-b5be2ac4-461e-4a15-972d-486073cdfd7d service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Received event network-vif-plugged-fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b346f962-43bc-4a7d-874c-4c609941d257 req-b5be2ac4-461e-4a15-972d-486073cdfd7d service nova] Acquiring lock "91932678-3ff4-40da-9900-b51c6f824404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b346f962-43bc-4a7d-874c-4c609941d257 req-b5be2ac4-461e-4a15-972d-486073cdfd7d service nova] Lock "91932678-3ff4-40da-9900-b51c6f824404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b346f962-43bc-4a7d-874c-4c609941d257 req-b5be2ac4-461e-4a15-972d-486073cdfd7d service nova] Lock "91932678-3ff4-40da-9900-b51c6f824404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:07:03 user nova-compute[80928]: DEBUG nova.compute.manager [req-b346f962-43bc-4a7d-874c-4c609941d257 req-b5be2ac4-461e-4a15-972d-486073cdfd7d service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] No waiting events found dispatching network-vif-plugged-fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:07:03 user nova-compute[80928]: WARNING nova.compute.manager [req-b346f962-43bc-4a7d-874c-4c609941d257 req-b5be2ac4-461e-4a15-972d-486073cdfd7d service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Received unexpected event network-vif-plugged-fa778f4b-755c-4c9d-94f0-15b57ebca609 for instance with vm_state building and task_state spawning.
Nov 16 06:07:03 user nova-compute[80928]: INFO nova.compute.manager [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Took 5.57 seconds to build instance.
Nov 16 06:07:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e0c11c15-5efd-41bf-a875-10f7c24cd6e4 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "91932678-3ff4-40da-9900-b51c6f824404" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.661s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:07:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:07:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:07:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:07:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:27 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:07:28 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:07:28 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:07:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:32 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:07:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:07:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:07:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:07:32 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:07:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 06:07:33 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:07:33 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:07:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8672MB free_disk=25.247478485107422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8b807b7a-3f9d-4558-9f1f-51a155d0fe51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance ee65f4e3-82cf-4d46-a787-538119b9a013 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 91932678-3ff4-40da-9900-b51c6f824404 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:07:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:07:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:36 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:07:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:07:36 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:07:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:07:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:07:37 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:07:37 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 8b807b7a-3f9d-4558-9f1f-51a155d0fe51 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:07:37 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updating instance_info_cache with network_info: [{"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:07:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:07:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:07:37 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:07:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:07:39 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:07:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:07:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:08:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:08:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:08:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:08:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:08:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:08:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:08:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:08:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:14 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:08:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:08:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:08:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:08:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:08:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:08:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:08:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:08:23 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:08:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:08:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:08:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:08:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:08:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-2ee3f282-786d-43f5-be5d-420d849a7877 req-9680e368-6659-492e-a6b0-d0fdc4ecd81a service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Received event network-changed-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:08:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-2ee3f282-786d-43f5-be5d-420d849a7877 req-9680e368-6659-492e-a6b0-d0fdc4ecd81a service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Refreshing instance network info cache due to event network-changed-5d5684fc-a66d-4cc5-b62b-6f3ef7144033. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:08:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2ee3f282-786d-43f5-be5d-420d849a7877 req-9680e368-6659-492e-a6b0-d0fdc4ecd81a service nova] Acquiring lock "refresh_cache-ee65f4e3-82cf-4d46-a787-538119b9a013" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:08:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2ee3f282-786d-43f5-be5d-420d849a7877 req-9680e368-6659-492e-a6b0-d0fdc4ecd81a service nova] Acquired lock "refresh_cache-ee65f4e3-82cf-4d46-a787-538119b9a013" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:08:27 user nova-compute[80928]: DEBUG nova.network.neutron [req-2ee3f282-786d-43f5-be5d-420d849a7877 req-9680e368-6659-492e-a6b0-d0fdc4ecd81a service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Refreshing network info cache for port 5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:08:27 user nova-compute[80928]: DEBUG nova.network.neutron [req-2ee3f282-786d-43f5-be5d-420d849a7877 req-9680e368-6659-492e-a6b0-d0fdc4ecd81a service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Updated VIF entry in instance network info cache for port 5d5684fc-a66d-4cc5-b62b-6f3ef7144033. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:08:27 user nova-compute[80928]: DEBUG nova.network.neutron [req-2ee3f282-786d-43f5-be5d-420d849a7877 req-9680e368-6659-492e-a6b0-d0fdc4ecd81a service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Updating instance_info_cache with network_info: [{"id": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "address": "fa:16:3e:76:38:01", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5684fc-a6", "ovs_interfaceid": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:08:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-2ee3f282-786d-43f5-be5d-420d849a7877 req-9680e368-6659-492e-a6b0-d0fdc4ecd81a service nova] Releasing lock "refresh_cache-ee65f4e3-82cf-4d46-a787-538119b9a013" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-a452b035-508b-4ec1-b855-f89f5aecbeb8 req-f646704c-3867-48c4-99f2-2bb1cafb4b2f service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Received event network-changed-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-a452b035-508b-4ec1-b855-f89f5aecbeb8 req-f646704c-3867-48c4-99f2-2bb1cafb4b2f service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Refreshing instance network info cache due to event network-changed-5d5684fc-a66d-4cc5-b62b-6f3ef7144033. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a452b035-508b-4ec1-b855-f89f5aecbeb8 req-f646704c-3867-48c4-99f2-2bb1cafb4b2f service nova] Acquiring lock "refresh_cache-ee65f4e3-82cf-4d46-a787-538119b9a013" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a452b035-508b-4ec1-b855-f89f5aecbeb8 req-f646704c-3867-48c4-99f2-2bb1cafb4b2f service nova] Acquired lock "refresh_cache-ee65f4e3-82cf-4d46-a787-538119b9a013" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG nova.network.neutron [req-a452b035-508b-4ec1-b855-f89f5aecbeb8 req-f646704c-3867-48c4-99f2-2bb1cafb4b2f service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Refreshing network info cache for port 5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "ee65f4e3-82cf-4d46-a787-538119b9a013" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:08:28 user nova-compute[80928]: INFO nova.compute.manager [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Terminating instance
Nov 16 06:08:28 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-e21c0e52-3760-4af6-8d7a-e646fcf395c5 req-9a14e8a7-053b-4657-a432-2ccdeb54bd81 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Received event network-vif-unplugged-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e21c0e52-3760-4af6-8d7a-e646fcf395c5 req-9a14e8a7-053b-4657-a432-2ccdeb54bd81 service nova] Acquiring lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e21c0e52-3760-4af6-8d7a-e646fcf395c5 req-9a14e8a7-053b-4657-a432-2ccdeb54bd81 service nova] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e21c0e52-3760-4af6-8d7a-e646fcf395c5 req-9a14e8a7-053b-4657-a432-2ccdeb54bd81 service nova] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-e21c0e52-3760-4af6-8d7a-e646fcf395c5 req-9a14e8a7-053b-4657-a432-2ccdeb54bd81 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] No waiting events found dispatching network-vif-unplugged-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-e21c0e52-3760-4af6-8d7a-e646fcf395c5 req-9a14e8a7-053b-4657-a432-2ccdeb54bd81 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Received event network-vif-unplugged-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG nova.network.neutron [req-a452b035-508b-4ec1-b855-f89f5aecbeb8 req-f646704c-3867-48c4-99f2-2bb1cafb4b2f service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Updated VIF entry in instance network info cache for port 5d5684fc-a66d-4cc5-b62b-6f3ef7144033. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG nova.network.neutron [req-a452b035-508b-4ec1-b855-f89f5aecbeb8 req-f646704c-3867-48c4-99f2-2bb1cafb4b2f service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Updating instance_info_cache with network_info: [{"id": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "address": "fa:16:3e:76:38:01", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5684fc-a6", "ovs_interfaceid": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:08:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a452b035-508b-4ec1-b855-f89f5aecbeb8 req-f646704c-3867-48c4-99f2-2bb1cafb4b2f service nova] Releasing lock "refresh_cache-ee65f4e3-82cf-4d46-a787-538119b9a013" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:08:28 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Instance destroyed successfully.
Nov 16 06:08:29 user nova-compute[80928]: DEBUG nova.objects.instance [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lazy-loading 'resources' on Instance uuid ee65f4e3-82cf-4d46-a787-538119b9a013 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-975782824',display_name='tempest-TestVolumeBootPattern-server-975782824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-975782824',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyY8s+sShXfJ+suwop52PyY173m6UiVR4KyrD50QIqQyrl3NE+BGSP1lDWf1O5bcLwC2JeVWfEj32kCuDLGs1JnxJaFNs8IkKGE+tPW/ARVCDA8B+/tdEVqq0AVOypNnA==',key_name='tempest-TestVolumeBootPattern-366323205',keypairs=<?>,launch_index=0,launched_at=2023-11-16T06:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-j9e85eyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T06:06:46Z,user_data=None,user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=ee65f4e3-82cf-4d46-a787-538119b9a013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "address": "fa:16:3e:76:38:01", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5684fc-a6", "ovs_interfaceid": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "address": "fa:16:3e:76:38:01", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d5684fc-a6", "ovs_interfaceid": "5d5684fc-a66d-4cc5-b62b-6f3ef7144033", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:38:01,bridge_name='br-int',has_traffic_filtering=True,id=5d5684fc-a66d-4cc5-b62b-6f3ef7144033,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5684fc-a6') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_vif [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:38:01,bridge_name='br-int',has_traffic_filtering=True,id=5d5684fc-a66d-4cc5-b62b-6f3ef7144033,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5684fc-a6') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d5684fc-a6, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=875e1c4a-3fcb-4ddc-aa1f-44e48582bc55) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:29 user nova-compute[80928]: INFO os_vif [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:38:01,bridge_name='br-int',has_traffic_filtering=True,id=5d5684fc-a66d-4cc5-b62b-6f3ef7144033,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d5684fc-a6')
Nov 16 06:08:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgTfAhQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:08:29 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ece0ae-ed36-48be-8750-368b0df87457]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:08:29 user nova-compute[80928]: No targets found.
Nov 16 06:08:29 user nova-compute[80928]: iSNS:
Nov 16 06:08:29 user nova-compute[80928]: No targets found.
Nov 16 06:08:29 user nova-compute[80928]: STATIC:
Nov 16 06:08:29 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571
Nov 16 06:08:29 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:08:29 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:08:29 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190
Nov 16 06:08:29 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:08:29 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:08:29 user nova-compute[80928]: FIRMWARE:
Nov 16 06:08:29 user nova-compute[80928]: No targets found.
Nov 16 06:08:29 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:08:29 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:08:29 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[331aced1-88a2-4ace-b87c-2c4d082390b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[68849de5-d64d-4b2f-bed8-3acfc0822db4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:08:29 user nova-compute[80928]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 (non-flash)
Nov 16 06:08:29 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:08:29 user nova-compute[80928]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 (non-flash)
Nov 16 06:08:29 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f865843b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[554b4894-0dda-48e6-acd3-bea962b4e690]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7649f49e-f708-4888-aeae-f52e5d053d52]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1007e2e5-e83c-42a6-9767-35266bc9d6c9]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb4b442-5ffb-491c-9e8f-edff06634aac]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a429b1c3-b8a2-4052-8392-69af3aae8492]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a62e4a-ce86-4104-add1-e8e526611161]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190, portal: 172.16.0.220,3260]
Nov 16 06:08:29 user nova-compute[80928]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190, portal: 172.16.0.220,3260] successful.
Nov 16 06:08:29 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aba436-d60d-428b-ada1-ded1958fc190 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1ebda7-e092-4d74-941b-aff0ffd26092]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== disconnect_volume: return (315ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:08:29 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Deleting instance files /opt/stack/data/nova/instances/ee65f4e3-82cf-4d46-a787-538119b9a013_del
Nov 16 06:08:29 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Deletion of /opt/stack/data/nova/instances/ee65f4e3-82cf-4d46-a787-538119b9a013_del complete
Nov 16 06:08:29 user nova-compute[80928]: INFO nova.compute.manager [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:08:29 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:08:30 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:08:30 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Took 0.69 seconds to deallocate network for instance.
Nov 16 06:08:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-12bd6463-79b3-45a6-9e9e-bd5add364ffa req-c2a2a1b2-a848-40f1-a289-a38e507a1794 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Received event network-vif-deleted-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:08:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-5573e812-58aa-4317-8fcb-98e490c8d61f req-4ff768ef-da14-4074-8237-cee67fccdd70 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Received event network-vif-plugged-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:08:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5573e812-58aa-4317-8fcb-98e490c8d61f req-4ff768ef-da14-4074-8237-cee67fccdd70 service nova] Acquiring lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:08:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5573e812-58aa-4317-8fcb-98e490c8d61f req-4ff768ef-da14-4074-8237-cee67fccdd70 service nova] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:08:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-5573e812-58aa-4317-8fcb-98e490c8d61f req-4ff768ef-da14-4074-8237-cee67fccdd70 service nova] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:08:30 user nova-compute[80928]: DEBUG nova.compute.manager [req-5573e812-58aa-4317-8fcb-98e490c8d61f req-4ff768ef-da14-4074-8237-cee67fccdd70 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] No waiting events found dispatching network-vif-plugged-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:08:30 user nova-compute[80928]: WARNING nova.compute.manager [req-5573e812-58aa-4317-8fcb-98e490c8d61f req-4ff768ef-da14-4074-8237-cee67fccdd70 service nova] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Received unexpected event network-vif-plugged-5d5684fc-a66d-4cc5-b62b-6f3ef7144033 for instance with vm_state active and task_state deleting.
Nov 16 06:08:30 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:08:30 user nova-compute[80928]: INFO nova.compute.manager [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: ee65f4e3-82cf-4d46-a787-538119b9a013] Took 0.74 seconds to detach 1 volumes for instance.
Nov 16 06:08:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:08:30 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:08:31 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:08:31 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:08:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:08:31 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Deleted allocations for instance ee65f4e3-82cf-4d46-a787-538119b9a013
Nov 16 06:08:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9cbef178-92ad-4664-9044-6baedd396076 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "ee65f4e3-82cf-4d46-a787-538119b9a013" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.004s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:08:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:32 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:08:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:08:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:08:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:08:32 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:08:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 06:08:33 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:08:33 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:08:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8863MB free_disk=25.246517181396484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 8b807b7a-3f9d-4558-9f1f-51a155d0fe51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 91932678-3ff4-40da-9900-b51c6f824404 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:08:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:08:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:37 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:08:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:08:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-91932678-3ff4-40da-9900-b51c6f824404" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:08:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-91932678-3ff4-40da-9900-b51c6f824404" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:08:38 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:08:38 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Updating instance_info_cache with network_info: [{"id": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "address": "fa:16:3e:79:34:92", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa778f4b-75", "ovs_interfaceid": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:08:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-91932678-3ff4-40da-9900-b51c6f824404" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:08:38 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:08:38 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:08:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:08:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:08:41 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:08:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "91932678-3ff4-40da-9900-b51c6f824404" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "91932678-3ff4-40da-9900-b51c6f824404" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "91932678-3ff4-40da-9900-b51c6f824404-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "91932678-3ff4-40da-9900-b51c6f824404-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "91932678-3ff4-40da-9900-b51c6f824404-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:08:49 user nova-compute[80928]: INFO nova.compute.manager [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Terminating instance
Nov 16 06:08:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-f5f1ce93-c8dc-4462-88c8-2ec6adf3bfb6 req-ff29ba60-8d57-4b47-949b-9767380559ba service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Received event network-vif-unplugged-fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f5f1ce93-c8dc-4462-88c8-2ec6adf3bfb6 req-ff29ba60-8d57-4b47-949b-9767380559ba service nova] Acquiring lock "91932678-3ff4-40da-9900-b51c6f824404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f5f1ce93-c8dc-4462-88c8-2ec6adf3bfb6 req-ff29ba60-8d57-4b47-949b-9767380559ba service nova] Lock "91932678-3ff4-40da-9900-b51c6f824404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-f5f1ce93-c8dc-4462-88c8-2ec6adf3bfb6 req-ff29ba60-8d57-4b47-949b-9767380559ba service nova] Lock "91932678-3ff4-40da-9900-b51c6f824404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-f5f1ce93-c8dc-4462-88c8-2ec6adf3bfb6 req-ff29ba60-8d57-4b47-949b-9767380559ba service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] No waiting events found dispatching network-vif-unplugged-fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG nova.compute.manager [req-f5f1ce93-c8dc-4462-88c8-2ec6adf3bfb6 req-ff29ba60-8d57-4b47-949b-9767380559ba service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Received event network-vif-unplugged-fa778f4b-755c-4c9d-94f0-15b57ebca609 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:08:49 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Instance destroyed successfully.
Nov 16 06:08:49 user nova-compute[80928]: DEBUG nova.objects.instance [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lazy-loading 'resources' on Instance uuid 91932678-3ff4-40da-9900-b51c6f824404 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1848710911',display_name='tempest-VolumesActionsTest-instance-1848710911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1848710911',id=49,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T06:07:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc3ac7d0f0bd4e60b5ea5403820f1dba',ramdisk_id='',reservation_id='r-yd4j09dn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-429150892',owner_user_name='tempest-VolumesActionsTest-429150892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T06:07:04Z,user_data=None,user_id='56314c196f8c49eca27951f9bb8fcd57',uuid=91932678-3ff4-40da-9900-b51c6f824404,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "address": "fa:16:3e:79:34:92", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa778f4b-75", "ovs_interfaceid": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Converting VIF {"id": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "address": "fa:16:3e:79:34:92", "network": {"id": "9d9135d7-998e-4d2e-83f1-0eb0f45cd560", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1541013961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc3ac7d0f0bd4e60b5ea5403820f1dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa778f4b-75", "ovs_interfaceid": "fa778f4b-755c-4c9d-94f0-15b57ebca609", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:34:92,bridge_name='br-int',has_traffic_filtering=True,id=fa778f4b-755c-4c9d-94f0-15b57ebca609,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa778f4b-75') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG os_vif [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:34:92,bridge_name='br-int',has_traffic_filtering=True,id=fa778f4b-755c-4c9d-94f0-15b57ebca609,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa778f4b-75') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa778f4b-75, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2af8d62b-3e89-46bc-ac48-a9e16efcd4d6) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:08:49 user nova-compute[80928]: INFO os_vif [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:34:92,bridge_name='br-int',has_traffic_filtering=True,id=fa778f4b-755c-4c9d-94f0-15b57ebca609,network=Network(9d9135d7-998e-4d2e-83f1-0eb0f45cd560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa778f4b-75')
Nov 16 06:08:49 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Deleting instance files /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404_del
Nov 16 06:08:49 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Deletion of /opt/stack/data/nova/instances/91932678-3ff4-40da-9900-b51c6f824404_del complete
Nov 16 06:08:50 user nova-compute[80928]: INFO nova.compute.manager [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 16 06:08:50 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:08:50 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:08:50 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 91932678-3ff4-40da-9900-b51c6f824404] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:08:50 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:08:50 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Took 0.88 seconds to deallocate network for instance.
Nov 16 06:08:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-bc272ceb-b4cc-4a9a-b3a0-4f577cc9b314 req-b53c85e0-8a4f-42d0-b2d7-0b3d5618263f service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Received event network-vif-deleted-fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:08:50 user nova-compute[80928]: INFO nova.compute.manager [req-bc272ceb-b4cc-4a9a-b3a0-4f577cc9b314 req-b53c85e0-8a4f-42d0-b2d7-0b3d5618263f service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Neutron deleted interface fa778f4b-755c-4c9d-94f0-15b57ebca609; detaching it from the instance and deleting it from the info cache
Nov 16 06:08:50 user nova-compute[80928]: DEBUG nova.network.neutron [req-bc272ceb-b4cc-4a9a-b3a0-4f577cc9b314 req-b53c85e0-8a4f-42d0-b2d7-0b3d5618263f service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:08:50 user nova-compute[80928]: DEBUG nova.compute.manager [req-bc272ceb-b4cc-4a9a-b3a0-4f577cc9b314 req-b53c85e0-8a4f-42d0-b2d7-0b3d5618263f service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Detach interface failed, port_id=fa778f4b-755c-4c9d-94f0-15b57ebca609, reason: Instance 91932678-3ff4-40da-9900-b51c6f824404 could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 06:08:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:08:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:08:51 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:08:51 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:08:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:08:51 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Deleted allocations for instance 91932678-3ff4-40da-9900-b51c6f824404
Nov 16 06:08:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-45a98db3-c28f-4783-bfb9-2d7f7cc37756 tempest-VolumesActionsTest-429150892 tempest-VolumesActionsTest-429150892-project-member] Lock "91932678-3ff4-40da-9900-b51c6f824404" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.858s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:08:51 user nova-compute[80928]: DEBUG nova.compute.manager [req-3949f6e8-0771-4cae-a2f3-f971e191a817 req-7db2714d-2536-4c6c-8ed0-a7c882e1c8f1 service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Received event network-vif-plugged-fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:08:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3949f6e8-0771-4cae-a2f3-f971e191a817 req-7db2714d-2536-4c6c-8ed0-a7c882e1c8f1 service nova] Acquiring lock "91932678-3ff4-40da-9900-b51c6f824404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:08:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3949f6e8-0771-4cae-a2f3-f971e191a817 req-7db2714d-2536-4c6c-8ed0-a7c882e1c8f1 service nova] Lock "91932678-3ff4-40da-9900-b51c6f824404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:08:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-3949f6e8-0771-4cae-a2f3-f971e191a817 req-7db2714d-2536-4c6c-8ed0-a7c882e1c8f1 service nova] Lock "91932678-3ff4-40da-9900-b51c6f824404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:08:51 user nova-compute[80928]: DEBUG nova.compute.manager [req-3949f6e8-0771-4cae-a2f3-f971e191a817 req-7db2714d-2536-4c6c-8ed0-a7c882e1c8f1 service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] No waiting events found dispatching network-vif-plugged-fa778f4b-755c-4c9d-94f0-15b57ebca609 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:08:51 user nova-compute[80928]: WARNING nova.compute.manager [req-3949f6e8-0771-4cae-a2f3-f971e191a817 req-7db2714d-2536-4c6c-8ed0-a7c882e1c8f1 service nova] [instance: 91932678-3ff4-40da-9900-b51c6f824404] Received unexpected event network-vif-plugged-fa778f4b-755c-4c9d-94f0-15b57ebca609 for instance with vm_state deleted and task_state None.
Nov 16 06:08:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:08:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:09:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:09:16 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:09:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:09:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:09:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-e5deae89-f77c-4d22-8da1-b2bff90e4863 req-fb6d15e7-4978-4e47-8c6e-46e827e41903 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Received event network-changed-f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:09:23 user nova-compute[80928]: DEBUG nova.compute.manager [req-e5deae89-f77c-4d22-8da1-b2bff90e4863 req-fb6d15e7-4978-4e47-8c6e-46e827e41903 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Refreshing instance network info cache due to event network-changed-f446e49a-0402-478e-94bb-3c2a2dd4b10f. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:09:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e5deae89-f77c-4d22-8da1-b2bff90e4863 req-fb6d15e7-4978-4e47-8c6e-46e827e41903 service nova] Acquiring lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:09:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e5deae89-f77c-4d22-8da1-b2bff90e4863 req-fb6d15e7-4978-4e47-8c6e-46e827e41903 service nova] Acquired lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:09:23 user nova-compute[80928]: DEBUG nova.network.neutron [req-e5deae89-f77c-4d22-8da1-b2bff90e4863 req-fb6d15e7-4978-4e47-8c6e-46e827e41903 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Refreshing network info cache for port f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:09:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:09:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:09:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:09:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:09:23 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:09:23 user nova-compute[80928]: INFO nova.compute.manager [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Terminating instance
Nov 16 06:09:23 user nova-compute[80928]: DEBUG nova.compute.manager [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:09:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG nova.network.neutron [req-e5deae89-f77c-4d22-8da1-b2bff90e4863 req-fb6d15e7-4978-4e47-8c6e-46e827e41903 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updated VIF entry in instance network info cache for port f446e49a-0402-478e-94bb-3c2a2dd4b10f. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG nova.network.neutron [req-e5deae89-f77c-4d22-8da1-b2bff90e4863 req-fb6d15e7-4978-4e47-8c6e-46e827e41903 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updating instance_info_cache with network_info: [{"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-e5deae89-f77c-4d22-8da1-b2bff90e4863 req-fb6d15e7-4978-4e47-8c6e-46e827e41903 service nova] Releasing lock "refresh_cache-8b807b7a-3f9d-4558-9f1f-51a155d0fe51" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-bb0a80ff-3833-4366-823b-d23d69cbda4d req-1decddca-d324-4639-9c8d-67a1f0d566b0 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Received event network-vif-unplugged-f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bb0a80ff-3833-4366-823b-d23d69cbda4d req-1decddca-d324-4639-9c8d-67a1f0d566b0 service nova] Acquiring lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bb0a80ff-3833-4366-823b-d23d69cbda4d req-1decddca-d324-4639-9c8d-67a1f0d566b0 service nova] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bb0a80ff-3833-4366-823b-d23d69cbda4d req-1decddca-d324-4639-9c8d-67a1f0d566b0 service nova] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-bb0a80ff-3833-4366-823b-d23d69cbda4d req-1decddca-d324-4639-9c8d-67a1f0d566b0 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] No waiting events found dispatching network-vif-unplugged-f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG nova.compute.manager [req-bb0a80ff-3833-4366-823b-d23d69cbda4d req-1decddca-d324-4639-9c8d-67a1f0d566b0 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Received event network-vif-unplugged-f446e49a-0402-478e-94bb-3c2a2dd4b10f for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:09:24 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Instance destroyed successfully.
Nov 16 06:09:24 user nova-compute[80928]: DEBUG nova.objects.instance [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lazy-loading 'resources' on Instance uuid 8b807b7a-3f9d-4558-9f1f-51a155d0fe51 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1325012474',display_name='tempest-TestVolumeBootPattern-server-1325012474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1325012474',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyY8s+sShXfJ+suwop52PyY173m6UiVR4KyrD50QIqQyrl3NE+BGSP1lDWf1O5bcLwC2JeVWfEj32kCuDLGs1JnxJaFNs8IkKGE+tPW/ARVCDA8B+/tdEVqq0AVOypNnA==',key_name='tempest-TestVolumeBootPattern-366323205',keypairs=<?>,launch_index=0,launched_at=2023-11-16T06:04:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b90f29809d44adfb12039c9b7910275',ramdisk_id='',reservation_id='r-010ha3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-315833619',owner_user_name='tempest-TestVolumeBootPattern-315833619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T06:04:49Z,user_data=None,user_id='3613cf4088874d1699e1feee5f6edc9f',uuid=8b807b7a-3f9d-4558-9f1f-51a155d0fe51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converting VIF {"id": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "address": "fa:16:3e:61:1f:98", "network": {"id": "82ff7e1c-ac3f-4289-9398-3f39ce1a7264", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1169426051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90f29809d44adfb12039c9b7910275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446e49a-04", "ovs_interfaceid": "f446e49a-0402-478e-94bb-3c2a2dd4b10f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:1f:98,bridge_name='br-int',has_traffic_filtering=True,id=f446e49a-0402-478e-94bb-3c2a2dd4b10f,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446e49a-04') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_vif [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:1f:98,bridge_name='br-int',has_traffic_filtering=True,id=f446e49a-0402-478e-94bb-3c2a2dd4b10f,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446e49a-04') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf446e49a-04, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6dae84f2-41fa-4356-b1f6-5de6e5442ed1) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:09:24 user nova-compute[80928]: INFO os_vif [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:1f:98,bridge_name='br-int',has_traffic_filtering=True,id=f446e49a-0402-478e-94bb-3c2a2dd4b10f,network=Network(82ff7e1c-ac3f-4289-9398-3f39ce1a7264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446e49a-04')
Nov 16 06:09:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdHxjwFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:09:24 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd90122-35bb-4671-98c9-d9d8e9c15c3e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:09:24 user nova-compute[80928]: No targets found.
Nov 16 06:09:24 user nova-compute[80928]: iSNS:
Nov 16 06:09:24 user nova-compute[80928]: No targets found.
Nov 16 06:09:24 user nova-compute[80928]: STATIC:
Nov 16 06:09:24 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571
Nov 16 06:09:24 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:09:24 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:09:24 user nova-compute[80928]: FIRMWARE:
Nov 16 06:09:24 user nova-compute[80928]: No targets found.
Nov 16 06:09:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:09:24 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:09:24 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[370b6dd4-1c61-4169-b8b0-8328c49bd95d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22d5e16-1c11-4d7f-b270-0c79b4416c6a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:09:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 (non-flash)
Nov 16 06:09:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8678232d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4e6585-5999-4c0f-b5f8-df1a6090a1a9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53fa8d3-6d12-4223-b6ba-04a4df6c5cd9]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.125s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7c27d8-2ce8-4b7d-ab37-332ae30b6103]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:09:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6eb7f8-7b0a-41ef-95bf-d81b1f229aab]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3684219b-c9160ad7add77edb', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3684219b', '/dev/disk/by-id/scsi-26339313630616437') {{(pid=92262) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc2aab9-3e1c-4c16-89b7-2b0313055d52]: (4, None) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[045e41b7-1320-459f-ad64-6c8831d97271]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e3916b-2988-4f18-8060-a9a9eded3988]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260]
Nov 16 06:09:25 user nova-compute[80928]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571, portal: 172.16.0.220,3260] successful.
Nov 16 06:09:25 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76a180df-0f5a-4d47-8f96-0a55f560e571 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c56252b-5941-4f0b-a612-fb72292f0e37]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] <== disconnect_volume: return (399ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:09:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Deleting instance files /opt/stack/data/nova/instances/8b807b7a-3f9d-4558-9f1f-51a155d0fe51_del
Nov 16 06:09:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Deletion of /opt/stack/data/nova/instances/8b807b7a-3f9d-4558-9f1f-51a155d0fe51_del complete
Nov 16 06:09:25 user nova-compute[80928]: INFO nova.compute.manager [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:09:25 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Took 0.46 seconds to deallocate network for instance.
Nov 16 06:09:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-7056ea5c-93cb-4f39-92b4-e240b3bce9fe req-cd10d844-585d-46e6-aef3-dee6f11cc98c service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Received event network-vif-deleted-f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:09:25 user nova-compute[80928]: INFO nova.compute.manager [req-7056ea5c-93cb-4f39-92b4-e240b3bce9fe req-cd10d844-585d-46e6-aef3-dee6f11cc98c service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Neutron deleted interface f446e49a-0402-478e-94bb-3c2a2dd4b10f; detaching it from the instance and deleting it from the info cache
Nov 16 06:09:25 user nova-compute[80928]: DEBUG nova.network.neutron [req-7056ea5c-93cb-4f39-92b4-e240b3bce9fe req-cd10d844-585d-46e6-aef3-dee6f11cc98c service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG nova.compute.manager [req-7056ea5c-93cb-4f39-92b4-e240b3bce9fe req-cd10d844-585d-46e6-aef3-dee6f11cc98c service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Detach interface failed, port_id=f446e49a-0402-478e-94bb-3c2a2dd4b10f, reason: Instance 8b807b7a-3f9d-4558-9f1f-51a155d0fe51 could not be found. {{(pid=80928) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 06:09:25 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:09:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-cc060ddd-74be-4de3-8485-62cfe3d2545c req-c5d1a511-1c1d-442a-b805-f3e9ec50b1c6 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Received event network-vif-plugged-f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:09:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc060ddd-74be-4de3-8485-62cfe3d2545c req-c5d1a511-1c1d-442a-b805-f3e9ec50b1c6 service nova] Acquiring lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:09:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc060ddd-74be-4de3-8485-62cfe3d2545c req-c5d1a511-1c1d-442a-b805-f3e9ec50b1c6 service nova] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:09:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-cc060ddd-74be-4de3-8485-62cfe3d2545c req-c5d1a511-1c1d-442a-b805-f3e9ec50b1c6 service nova] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:09:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-cc060ddd-74be-4de3-8485-62cfe3d2545c req-c5d1a511-1c1d-442a-b805-f3e9ec50b1c6 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] No waiting events found dispatching network-vif-plugged-f446e49a-0402-478e-94bb-3c2a2dd4b10f {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:09:26 user nova-compute[80928]: WARNING nova.compute.manager [req-cc060ddd-74be-4de3-8485-62cfe3d2545c req-c5d1a511-1c1d-442a-b805-f3e9ec50b1c6 service nova] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Received unexpected event network-vif-plugged-f446e49a-0402-478e-94bb-3c2a2dd4b10f for instance with vm_state active and task_state deleting.
Nov 16 06:09:26 user nova-compute[80928]: INFO nova.compute.manager [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] [instance: 8b807b7a-3f9d-4558-9f1f-51a155d0fe51] Took 0.69 seconds to detach 1 volumes for instance.
Nov 16 06:09:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:09:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:09:26 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:09:26 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:09:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:09:26 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Deleted allocations for instance 8b807b7a-3f9d-4558-9f1f-51a155d0fe51
Nov 16 06:09:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-cde2a65b-1333-42e1-9423-364a7b988c27 tempest-TestVolumeBootPattern-315833619 tempest-TestVolumeBootPattern-315833619-project-member] Lock "8b807b7a-3f9d-4558-9f1f-51a155d0fe51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.693s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:09:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:29 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:09:29 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:09:30 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:09:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:34 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:09:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:09:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:09:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:09:34 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:09:35 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:09:35 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:09:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=9082MB free_disk=25.27334976196289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:09:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:09:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:09:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:09:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:09:35 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:09:35 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:09:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:09:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:09:37 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:09:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:09:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:09:37 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 06:09:37 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:09:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:09:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:09:41 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:09:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:09:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:09:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:09:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:09:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:09:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:09:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:10:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:10:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:16 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:10:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:10:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "adea89d7-7687-4b12-b14e-f6728191f49e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:10:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "adea89d7-7687-4b12-b14e-f6728191f49e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:10:24 user nova-compute[80928]: DEBUG nova.compute.manager [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 06:10:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:10:24 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:10:24 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 06:10:24 user nova-compute[80928]: INFO nova.compute.claims [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Claim successful on node user
Nov 16 06:10:25 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG nova.network.neutron [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 06:10:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 06:10:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 06:10:25 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Creating image(s)
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "/opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "/opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "/opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG nova.policy [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9f5bace66414d8e8afff94043028c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc549bcee377449aa6c8a52b08287394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk 1073741824" returned: 0 in 0.050s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 06:10:25 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:10:26 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:10:26 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Cannot resize image /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 06:10:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 06:10:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Ensure instance console log exists: /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 06:10:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:10:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:10:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:10:26 user nova-compute[80928]: DEBUG nova.network.neutron [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Successfully created port: b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 06:10:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:26 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:10:26 user nova-compute[80928]: DEBUG nova.network.neutron [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Successfully updated port: b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-c80bea39-05e3-4421-a6fb-c7c567038122 req-b03f8bc8-ed93-4af8-aac7-78a07ba8e182 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Received event network-changed-b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-c80bea39-05e3-4421-a6fb-c7c567038122 req-b03f8bc8-ed93-4af8-aac7-78a07ba8e182 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Refreshing instance network info cache due to event network-changed-b3cf98db-2067-4508-b968-60bd9c94d4b1. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c80bea39-05e3-4421-a6fb-c7c567038122 req-b03f8bc8-ed93-4af8-aac7-78a07ba8e182 service nova] Acquiring lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c80bea39-05e3-4421-a6fb-c7c567038122 req-b03f8bc8-ed93-4af8-aac7-78a07ba8e182 service nova] Acquired lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.network.neutron [req-c80bea39-05e3-4421-a6fb-c7c567038122 req-b03f8bc8-ed93-4af8-aac7-78a07ba8e182 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Refreshing network info cache for port b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.network.neutron [req-c80bea39-05e3-4421-a6fb-c7c567038122 req-b03f8bc8-ed93-4af8-aac7-78a07ba8e182 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.network.neutron [req-c80bea39-05e3-4421-a6fb-c7c567038122 req-b03f8bc8-ed93-4af8-aac7-78a07ba8e182 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c80bea39-05e3-4421-a6fb-c7c567038122 req-b03f8bc8-ed93-4af8-aac7-78a07ba8e182 service nova] Releasing lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquired lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.network.neutron [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.network.neutron [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.network.neutron [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Updating instance_info_cache with network_info: [{"id": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "address": "fa:16:3e:de:cc:c1", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cf98db-20", "ovs_interfaceid": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Releasing lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Instance network_info: |[{"id": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "address": "fa:16:3e:de:cc:c1", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cf98db-20", "ovs_interfaceid": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Start _get_guest_xml network_info=[{"id": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "address": "fa:16:3e:de:cc:c1", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cf98db-20", "ovs_interfaceid": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 06:10:27 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:10:27 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1091438612',display_name='tempest-VolumesSnapshotTestJSON-instance-1091438612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1091438612',id=50,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt61A3zFLLkmFOUaHOf1XJhDUjfmxi5J4R51DNd9pcZVJRGwf4fAS66taV4duCIIDV3gZsL5wfoJKGNu06xXY8zQGY9kVJD2gXvLtLPuS5V2MCUVn5jq0vbnUeKNCCJJw==',key_name='tempest-keypair-1400929390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc549bcee377449aa6c8a52b08287394',ramdisk_id='',reservation_id='r-8a2hnd3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1184312540',owner_user_name='tempest-VolumesSnapshotTestJSON-1184312540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f5bace66414d8e8afff94043028c7b',uuid=adea89d7-7687-4b12-b14e-f6728191f49e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "address": "fa:16:3e:de:cc:c1", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cf98db-20", "ovs_interfaceid": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Converting VIF {"id": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "address": "fa:16:3e:de:cc:c1", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cf98db-20", "ovs_interfaceid": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:cc:c1,bridge_name='br-int',has_traffic_filtering=True,id=b3cf98db-2067-4508-b968-60bd9c94d4b1,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cf98db-20') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.objects.instance [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lazy-loading 'pci_devices' on Instance uuid adea89d7-7687-4b12-b14e-f6728191f49e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 06:10:27 user nova-compute[80928]:   <uuid>adea89d7-7687-4b12-b14e-f6728191f49e</uuid>
Nov 16 06:10:27 user nova-compute[80928]:   <name>instance-00000032</name>
Nov 16 06:10:27 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 06:10:27 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 06:10:27 user nova-compute[80928]:   <metadata>
Nov 16 06:10:27 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 06:10:27 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 06:10:27 user nova-compute[80928]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1091438612</nova:name>
Nov 16 06:10:27 user nova-compute[80928]:       <nova:creationTime>2023-11-16 06:10:27</nova:creationTime>
Nov 16 06:10:27 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 06:10:27 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 06:10:27 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 06:10:27 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 06:10:27 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 06:10:27 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 06:10:27 user nova-compute[80928]:       </nova:flavor>
Nov 16 06:10:27 user nova-compute[80928]:       <nova:owner>
Nov 16 06:10:27 user nova-compute[80928]:         <nova:user uuid="b9f5bace66414d8e8afff94043028c7b">tempest-VolumesSnapshotTestJSON-1184312540-project-member</nova:user>
Nov 16 06:10:27 user nova-compute[80928]:         <nova:project uuid="cc549bcee377449aa6c8a52b08287394">tempest-VolumesSnapshotTestJSON-1184312540</nova:project>
Nov 16 06:10:27 user nova-compute[80928]:       </nova:owner>
Nov 16 06:10:27 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 06:10:27 user nova-compute[80928]:       <nova:ports>
Nov 16 06:10:27 user nova-compute[80928]:         <nova:port uuid="b3cf98db-2067-4508-b968-60bd9c94d4b1">
Nov 16 06:10:27 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 06:10:27 user nova-compute[80928]:         </nova:port>
Nov 16 06:10:27 user nova-compute[80928]:       </nova:ports>
Nov 16 06:10:27 user nova-compute[80928]:     </nova:instance>
Nov 16 06:10:27 user nova-compute[80928]:   </metadata>
Nov 16 06:10:27 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 06:10:27 user nova-compute[80928]:     <system>
Nov 16 06:10:27 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 06:10:27 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 06:10:27 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 06:10:27 user nova-compute[80928]:       <entry name="serial">adea89d7-7687-4b12-b14e-f6728191f49e</entry>
Nov 16 06:10:27 user nova-compute[80928]:       <entry name="uuid">adea89d7-7687-4b12-b14e-f6728191f49e</entry>
Nov 16 06:10:27 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 06:10:27 user nova-compute[80928]:     </system>
Nov 16 06:10:27 user nova-compute[80928]:   </sysinfo>
Nov 16 06:10:27 user nova-compute[80928]:   <os>
Nov 16 06:10:27 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 06:10:27 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 06:10:27 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 06:10:27 user nova-compute[80928]:   </os>
Nov 16 06:10:27 user nova-compute[80928]:   <features>
Nov 16 06:10:27 user nova-compute[80928]:     <acpi/>
Nov 16 06:10:27 user nova-compute[80928]:     <apic/>
Nov 16 06:10:27 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 06:10:27 user nova-compute[80928]:   </features>
Nov 16 06:10:27 user nova-compute[80928]:   <clock offset="utc">
Nov 16 06:10:27 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 06:10:27 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 06:10:27 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 06:10:27 user nova-compute[80928]:   </clock>
Nov 16 06:10:27 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 06:10:27 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 06:10:27 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 06:10:27 user nova-compute[80928]:   </cpu>
Nov 16 06:10:27 user nova-compute[80928]:   <devices>
Nov 16 06:10:27 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 06:10:27 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 06:10:27 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk"/>
Nov 16 06:10:27 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 06:10:27 user nova-compute[80928]:     </disk>
Nov 16 06:10:27 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 06:10:27 user nova-compute[80928]:       <mac address="fa:16:3e:de:cc:c1"/>
Nov 16 06:10:27 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:10:27 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 06:10:27 user nova-compute[80928]:       <target dev="tapb3cf98db-20"/>
Nov 16 06:10:27 user nova-compute[80928]:     </interface>
Nov 16 06:10:27 user nova-compute[80928]:     <serial type="pty">
Nov 16 06:10:27 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/console.log" append="off"/>
Nov 16 06:10:27 user nova-compute[80928]:     </serial>
Nov 16 06:10:27 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 06:10:27 user nova-compute[80928]:     <video>
Nov 16 06:10:27 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:10:27 user nova-compute[80928]:     </video>
Nov 16 06:10:27 user nova-compute[80928]:     <rng model="virtio">
Nov 16 06:10:27 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 06:10:27 user nova-compute[80928]:     </rng>
Nov 16 06:10:27 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 06:10:27 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 06:10:27 user nova-compute[80928]:       <stats period="10"/>
Nov 16 06:10:27 user nova-compute[80928]:     </memballoon>
Nov 16 06:10:27 user nova-compute[80928]:   </devices>
Nov 16 06:10:27 user nova-compute[80928]: </domain>
Nov 16 06:10:27 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1091438612',display_name='tempest-VolumesSnapshotTestJSON-instance-1091438612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1091438612',id=50,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt61A3zFLLkmFOUaHOf1XJhDUjfmxi5J4R51DNd9pcZVJRGwf4fAS66taV4duCIIDV3gZsL5wfoJKGNu06xXY8zQGY9kVJD2gXvLtLPuS5V2MCUVn5jq0vbnUeKNCCJJw==',key_name='tempest-keypair-1400929390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc549bcee377449aa6c8a52b08287394',ramdisk_id='',reservation_id='r-8a2hnd3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1184312540',owner_user_name='tempest-VolumesSnapshotTestJSON-1184312540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f5bace66414d8e8afff94043028c7b',uuid=adea89d7-7687-4b12-b14e-f6728191f49e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "address": "fa:16:3e:de:cc:c1", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cf98db-20", "ovs_interfaceid": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Converting VIF {"id": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "address": "fa:16:3e:de:cc:c1", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cf98db-20", "ovs_interfaceid": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:cc:c1,bridge_name='br-int',has_traffic_filtering=True,id=b3cf98db-2067-4508-b968-60bd9c94d4b1,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cf98db-20') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG os_vif [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:cc:c1,bridge_name='br-int',has_traffic_filtering=True,id=b3cf98db-2067-4508-b968-60bd9c94d4b1,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cf98db-20') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bd68abb-0c54-5dba-8148-2ed908c85fc2', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3cf98db-20, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3cf98db-20, col_values=(('qos', UUID('8911bd16-5b6b-475a-947e-84e4335ba8d7')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3cf98db-20, col_values=(('external_ids', {'iface-id': 'b3cf98db-2067-4508-b968-60bd9c94d4b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:cc:c1', 'vm-uuid': 'adea89d7-7687-4b12-b14e-f6728191f49e'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:27 user nova-compute[80928]: INFO os_vif [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:cc:c1,bridge_name='br-int',has_traffic_filtering=True,id=b3cf98db-2067-4508-b968-60bd9c94d4b1,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cf98db-20')
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:10:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] No VIF found with MAC fa:16:3e:de:cc:c1, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:10:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-c175cbad-8099-4081-92f3-11d28ae358ee req-8d2a2abe-880d-47b0-8815-8bda2e96a43e service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Received event network-vif-plugged-b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:10:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c175cbad-8099-4081-92f3-11d28ae358ee req-8d2a2abe-880d-47b0-8815-8bda2e96a43e service nova] Acquiring lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:10:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c175cbad-8099-4081-92f3-11d28ae358ee req-8d2a2abe-880d-47b0-8815-8bda2e96a43e service nova] Lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:10:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-c175cbad-8099-4081-92f3-11d28ae358ee req-8d2a2abe-880d-47b0-8815-8bda2e96a43e service nova] Lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:10:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-c175cbad-8099-4081-92f3-11d28ae358ee req-8d2a2abe-880d-47b0-8815-8bda2e96a43e service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] No waiting events found dispatching network-vif-plugged-b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:10:29 user nova-compute[80928]: WARNING nova.compute.manager [req-c175cbad-8099-4081-92f3-11d28ae358ee req-8d2a2abe-880d-47b0-8815-8bda2e96a43e service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Received unexpected event network-vif-plugged-b3cf98db-2067-4508-b968-60bd9c94d4b1 for instance with vm_state building and task_state spawning.
Nov 16 06:10:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG nova.compute.manager [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 06:10:31 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Instance spawned successfully.
Nov 16 06:10:31 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-38440c9f-d893-447d-b654-519039f78185 req-41c70706-011b-46e8-88d0-2bdf1ddf261f service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Received event network-vif-plugged-b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-38440c9f-d893-447d-b654-519039f78185 req-41c70706-011b-46e8-88d0-2bdf1ddf261f service nova] Acquiring lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-38440c9f-d893-447d-b654-519039f78185 req-41c70706-011b-46e8-88d0-2bdf1ddf261f service nova] Lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-38440c9f-d893-447d-b654-519039f78185 req-41c70706-011b-46e8-88d0-2bdf1ddf261f service nova] Lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-38440c9f-d893-447d-b654-519039f78185 req-41c70706-011b-46e8-88d0-2bdf1ddf261f service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] No waiting events found dispatching network-vif-plugged-b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:10:31 user nova-compute[80928]: WARNING nova.compute.manager [req-38440c9f-d893-447d-b654-519039f78185 req-41c70706-011b-46e8-88d0-2bdf1ddf261f service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Received unexpected event network-vif-plugged-b3cf98db-2067-4508-b968-60bd9c94d4b1 for instance with vm_state building and task_state spawning.
Nov 16 06:10:31 user nova-compute[80928]: INFO nova.compute.manager [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 16 06:10:31 user nova-compute[80928]: DEBUG nova.compute.manager [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 06:10:31 user nova-compute[80928]: INFO nova.compute.manager [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Took 6.55 seconds to build instance.
Nov 16 06:10:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-442aa785-ae07-4c0d-8ea9-99f5ac2c6cf5 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "adea89d7-7687-4b12-b14e-f6728191f49e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.663s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:10:31 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:10:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:32 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:10:32 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances with incomplete migration  {{(pid=80928) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 06:10:34 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:10:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:10:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:10:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:10:34 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:10:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:10:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:10:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:10:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:10:35 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:10:35 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:10:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=9012MB free_disk=25.26165008544922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:10:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:10:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:10:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance adea89d7-7687-4b12-b14e-f6728191f49e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:10:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:10:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:10:35 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing inventories for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 06:10:35 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating ProviderTree inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 06:10:35 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 06:10:35 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing aggregate associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, aggregates: None {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 06:10:36 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing trait associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 06:10:36 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:10:36 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:10:36 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:10:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:10:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:10:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:10:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:10:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:10:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:10:39 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:10:39 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:10:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:10:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:10:39 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:10:39 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid adea89d7-7687-4b12-b14e-f6728191f49e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:10:39 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Updating instance_info_cache with network_info: [{"id": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "address": "fa:16:3e:de:cc:c1", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cf98db-20", "ovs_interfaceid": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:10:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:10:39 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:10:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:10:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:10:42 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:10:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:10:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:47 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:10:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:10:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:11:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:11:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:11:03 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:11:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 06:11:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] There are 0 instances to clean {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 06:11:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:11:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:11:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:11:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:11:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:11:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:11:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:11:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:11:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:11:18 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:11:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:11:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:11:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:11:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:11:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:11:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:11:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:11:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:11:28 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:11:30 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:11:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:11:32 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:11:33 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:11:34 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:11:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:11:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:11:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:11:34 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:11:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:11:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:11:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:11:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:11:35 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:11:35 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:11:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=25.23247528076172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:11:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:11:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:11:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance adea89d7-7687-4b12-b14e-f6728191f49e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:11:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:11:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:11:35 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:11:35 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:11:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:11:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:11:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:11:40 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:11:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:11:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:11:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:11:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:11:40 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:11:40 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid adea89d7-7687-4b12-b14e-f6728191f49e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:11:41 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Updating instance_info_cache with network_info: [{"id": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "address": "fa:16:3e:de:cc:c1", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cf98db-20", "ovs_interfaceid": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:11:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:11:41 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:11:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:11:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:11:43 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:11:43 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:11:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:11:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:11:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:11:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:11:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:11:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:11:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:11:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:11:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:11:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:11:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:11:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:11:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:12:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:12:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:12:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:12:02 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:12:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:12:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:12:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:12:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:12:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-edc9e3d1-758f-4db3-8e4a-22984b87b6fa req-65979ef5-9679-4c47-89ed-1a8121c6faf7 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Received event network-changed-b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:12:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-edc9e3d1-758f-4db3-8e4a-22984b87b6fa req-65979ef5-9679-4c47-89ed-1a8121c6faf7 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Refreshing instance network info cache due to event network-changed-b3cf98db-2067-4508-b968-60bd9c94d4b1. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:12:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-edc9e3d1-758f-4db3-8e4a-22984b87b6fa req-65979ef5-9679-4c47-89ed-1a8121c6faf7 service nova] Acquiring lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:12:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-edc9e3d1-758f-4db3-8e4a-22984b87b6fa req-65979ef5-9679-4c47-89ed-1a8121c6faf7 service nova] Acquired lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:12:15 user nova-compute[80928]: DEBUG nova.network.neutron [req-edc9e3d1-758f-4db3-8e4a-22984b87b6fa req-65979ef5-9679-4c47-89ed-1a8121c6faf7 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Refreshing network info cache for port b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "adea89d7-7687-4b12-b14e-f6728191f49e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "adea89d7-7687-4b12-b14e-f6728191f49e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lazy-loading 'flavor' on Instance uuid adea89d7-7687-4b12-b14e-f6728191f49e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:12:16 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Ignoring supplied device name: /dev/vdb
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "adea89d7-7687-4b12-b14e-f6728191f49e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG nova.network.neutron [req-edc9e3d1-758f-4db3-8e4a-22984b87b6fa req-65979ef5-9679-4c47-89ed-1a8121c6faf7 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Updated VIF entry in instance network info cache for port b3cf98db-2067-4508-b968-60bd9c94d4b1. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG nova.network.neutron [req-edc9e3d1-758f-4db3-8e4a-22984b87b6fa req-65979ef5-9679-4c47-89ed-1a8121c6faf7 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Updating instance_info_cache with network_info: [{"id": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "address": "fa:16:3e:de:cc:c1", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cf98db-20", "ovs_interfaceid": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "adea89d7-7687-4b12-b14e-f6728191f49e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "adea89d7-7687-4b12-b14e-f6728191f49e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:12:16 user nova-compute[80928]: INFO nova.compute.manager [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Attaching volume 974bbbed-fc4b-492f-a145-856620e36637 to /dev/vdb
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-edc9e3d1-758f-4db3-8e4a-22984b87b6fa req-65979ef5-9679-4c47-89ed-1a8121c6faf7 service nova] Releasing lock "refresh_cache-adea89d7-7687-4b12-b14e-f6728191f49e" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG os_brick.utils [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5db1ce0-9492-4c2f-9e0e-5c275a66afb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[338b285a-0a60-4966-8e86-a761fe9c6b01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ea172c-09d2-4e9b-9cfe-ccb270c2b8a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[018e89c8-148a-48e4-b3bd-f658cbc6e653]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:12:16 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:12:16 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0640e6-f97b-4b15-b1b4-6891701224f8]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG os_brick.utils [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Updating existing volume attachment record: 3d432d3f-b9a5-4376-a3e7-aa2b7d9a0a0a {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:12:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxpuRQEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:12:21 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:12:21 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:12:21 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daccd26-b003-4aec-8b17-8471d2da4b2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:12:21 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e369c639-7601-43e9-9b94-831ad20a8c4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637] added
Nov 16 06:12:21 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa2c794-13e0-4ac3-b681-f3cf57b99185]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d69f5a-b474-41d8-ac5f-4c9014d5d1fe]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxpuRQEN {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxpuRQEN" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80a0421-eb73-4ce0-9e9d-05de9658dd36]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HxpuRQEN'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[841972c4-1a9c-4ea6-b3f4-3a3a11b61fe2]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88c1222-f714-4b4b-a701-b546fcbaed6f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:12:21 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:12:21 user nova-compute[80928]:  {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:12:21 user nova-compute[80928]: WARNING os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 06:12:21 user nova-compute[80928]: 
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[89afdeba-15b6-4109-b125-31855c7c11d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637, portal: 172.16.0.220,3260]
Nov 16 06:12:21 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637, portal: 172.16.0.220,3260] successful.
Nov 16 06:12:21 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da49657-4061-49d5-8e9f-3bb50a96eeaa]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab2290d-2fb6-48ce-8d22-19e00eacedea]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 (non-flash)
Nov 16 06:12:21 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 (non-flash)
Nov 16 06:12:21 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e1af71-7e9c-4f08-ada2-618258b0e06d]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:12:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxpuRQEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23237663439303632', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237663439303632', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG nova.objects.instance [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lazy-loading 'flavor' on Instance uuid adea89d7-7687-4b12-b14e-f6728191f49e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 06:12:22 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:12:22 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:12:22 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:12:22 user nova-compute[80928]:   <serial>974bbbed-fc4b-492f-a145-856620e36637</serial>
Nov 16 06:12:22 user nova-compute[80928]: </disk>
Nov 16 06:12:22 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] No VIF found with MAC fa:16:3e:de:cc:c1, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:12:22 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-c6a6ba47-2424-455b-bf04-f06da8bac7b6 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "adea89d7-7687-4b12-b14e-f6728191f49e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.638s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:12:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:27 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:29 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:12:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:32 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:33 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:12:34 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:12:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:12:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:12:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:12:34 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:12:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 06:12:35 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:12:35 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:12:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=9005MB free_disk=25.23143768310547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance adea89d7-7687-4b12-b14e-f6728191f49e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:12:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:12:36 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:12:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "adea89d7-7687-4b12-b14e-f6728191f49e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:12:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "adea89d7-7687-4b12-b14e-f6728191f49e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:12:37 user nova-compute[80928]: INFO nova.compute.manager [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Detaching volume 974bbbed-fc4b-492f-a145-856620e36637
Nov 16 06:12:37 user nova-compute[80928]: INFO nova.virt.block_device [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Attempting to driver detach volume 974bbbed-fc4b-492f-a145-856620e36637 from mountpoint /dev/vdb
Nov 16 06:12:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Attempting to detach device vdb from instance adea89d7-7687-4b12-b14e-f6728191f49e from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 06:12:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:12:37 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:12:37 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:12:37 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:12:37 user nova-compute[80928]:   <serial>974bbbed-fc4b-492f-a145-856620e36637</serial>
Nov 16 06:12:37 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:12:37 user nova-compute[80928]: </disk>
Nov 16 06:12:37 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:12:37 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Successfully detached device vdb from instance adea89d7-7687-4b12-b14e-f6728191f49e from the persistent domain config.
Nov 16 06:12:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance adea89d7-7687-4b12-b14e-f6728191f49e from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 06:12:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:12:37 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:12:37 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:12:37 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:12:37 user nova-compute[80928]:   <serial>974bbbed-fc4b-492f-a145-856620e36637</serial>
Nov 16 06:12:37 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:12:37 user nova-compute[80928]: </disk>
Nov 16 06:12:37 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:12:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "adea89d7-7687-4b12-b14e-f6728191f49e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:12:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:12:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:12:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:12:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:12:37 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance adea89d7-7687-4b12-b14e-f6728191f49e {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 06:12:40 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:12:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:12:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:12:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Skipping network cache update for instance because it is being deleted. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 16 06:12:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 06:12:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:12:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:12:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:12:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:12:42 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:42 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:12:45 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:12:45 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:12:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:47 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:12:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:12:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:12:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:12:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:12:52 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:57 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance adea89d7-7687-4b12-b14e-f6728191f49e is timed out.
Nov 16 06:12:57 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Successfully detached device vdb from instance adea89d7-7687-4b12-b14e-f6728191f49e from the live domain config.
Nov 16 06:12:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxpuRQEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:12:57 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:12:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa52048-91f9-4492-958e-748db9b14f5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:12:57 user nova-compute[80928]: No targets found.
Nov 16 06:12:57 user nova-compute[80928]: iSNS:
Nov 16 06:12:57 user nova-compute[80928]: No targets found.
Nov 16 06:12:57 user nova-compute[80928]: STATIC:
Nov 16 06:12:57 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637
Nov 16 06:12:57 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:12:57 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:12:57 user nova-compute[80928]: FIRMWARE:
Nov 16 06:12:57 user nova-compute[80928]: No targets found.
Nov 16 06:12:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:12:57 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:12:57 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3538e4bc-2ee7-4181-aea8-31f5e7f6bc86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abbca74-1e76-4853-b2ad-6bfac074aaf0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 (non-flash)
Nov 16 06:12:58 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 (non-flash)
Nov 16 06:12:58 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585cf910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ae3dfb-f02b-4407-b109-b75cb7b17d1a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec0d51e-bafc-4a18-8db6-42dd76618732]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b3641e-b2ee-4ab7-8414-ba5d3777e4ac]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[795b0312-9478-4f9c-ad35-d2892733eb9c]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3681ebb6-4113-4f5f-954b-c1b449f9f9df]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[999c04a9-12e0-44a2-8c2e-3b725a03e2e5]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637, portal: 172.16.0.220,3260]
Nov 16 06:12:58 user nova-compute[80928]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637, portal: 172.16.0.220,3260] successful.
Nov 16 06:12:58 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8cebb2-ef63-4f14-be9e-9274e0ea2e55]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] <== disconnect_volume: return (274ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lazy-loading 'flavor' on Instance uuid adea89d7-7687-4b12-b14e-f6728191f49e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7168cdf0-b2c7-41d3-a16e-d981b6807b8d tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "adea89d7-7687-4b12-b14e-f6728191f49e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.579s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "adea89d7-7687-4b12-b14e-f6728191f49e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.457s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:12:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:12:58 user nova-compute[80928]: INFO nova.compute.manager [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Terminating instance
Nov 16 06:12:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-53bcae97-f765-4315-a655-a35145247dcc req-73d65427-d267-4a5c-96fb-e9007df9ca5c service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Received event network-vif-unplugged-b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-53bcae97-f765-4315-a655-a35145247dcc req-73d65427-d267-4a5c-96fb-e9007df9ca5c service nova] Acquiring lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-53bcae97-f765-4315-a655-a35145247dcc req-73d65427-d267-4a5c-96fb-e9007df9ca5c service nova] Lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-53bcae97-f765-4315-a655-a35145247dcc req-73d65427-d267-4a5c-96fb-e9007df9ca5c service nova] Lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-53bcae97-f765-4315-a655-a35145247dcc req-73d65427-d267-4a5c-96fb-e9007df9ca5c service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] No waiting events found dispatching network-vif-unplugged-b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG nova.compute.manager [req-53bcae97-f765-4315-a655-a35145247dcc req-73d65427-d267-4a5c-96fb-e9007df9ca5c service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Received event network-vif-unplugged-b3cf98db-2067-4508-b968-60bd9c94d4b1 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:59 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Instance destroyed successfully.
Nov 16 06:12:59 user nova-compute[80928]: DEBUG nova.objects.instance [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lazy-loading 'resources' on Instance uuid adea89d7-7687-4b12-b14e-f6728191f49e {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1091438612',display_name='tempest-VolumesSnapshotTestJSON-instance-1091438612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1091438612',id=50,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt61A3zFLLkmFOUaHOf1XJhDUjfmxi5J4R51DNd9pcZVJRGwf4fAS66taV4duCIIDV3gZsL5wfoJKGNu06xXY8zQGY9kVJD2gXvLtLPuS5V2MCUVn5jq0vbnUeKNCCJJw==',key_name='tempest-keypair-1400929390',keypairs=<?>,launch_index=0,launched_at=2023-11-16T06:10:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc549bcee377449aa6c8a52b08287394',ramdisk_id='',reservation_id='r-8a2hnd3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1184312540',owner_user_name='tempest-VolumesSnapshotTestJSON-1184312540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T06:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f5bace66414d8e8afff94043028c7b',uuid=adea89d7-7687-4b12-b14e-f6728191f49e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "address": "fa:16:3e:de:cc:c1", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cf98db-20", "ovs_interfaceid": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Converting VIF {"id": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "address": "fa:16:3e:de:cc:c1", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cf98db-20", "ovs_interfaceid": "b3cf98db-2067-4508-b968-60bd9c94d4b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:cc:c1,bridge_name='br-int',has_traffic_filtering=True,id=b3cf98db-2067-4508-b968-60bd9c94d4b1,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cf98db-20') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG os_vif [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:cc:c1,bridge_name='br-int',has_traffic_filtering=True,id=b3cf98db-2067-4508-b968-60bd9c94d4b1,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cf98db-20') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3cf98db-20, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8911bd16-5b6b-475a-947e-84e4335ba8d7) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:12:59 user nova-compute[80928]: INFO os_vif [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:cc:c1,bridge_name='br-int',has_traffic_filtering=True,id=b3cf98db-2067-4508-b968-60bd9c94d4b1,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cf98db-20')
Nov 16 06:12:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:974bbbed-fc4b-492f-a145-856620e36637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxpuRQEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:12:59 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:12:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[d3dfb0eb-4e91-4982-908b-a8cb08bb0480]: Unexpected error while running command.
Nov 16 06:12:59 user nova-compute[80928]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 16 06:12:59 user nova-compute[80928]: Exit code: 21
Nov 16 06:12:59 user nova-compute[80928]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 16 06:12:59 user nova-compute[80928]: Stderr: '' {{(pid=92262) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 16 06:12:59 user nova-compute[80928]: Traceback (most recent call last):
Nov 16 06:12:59 user nova-compute[80928]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 16 06:12:59 user nova-compute[80928]:     ret = func(*f_args, **f_kwargs)
Nov 16 06:12:59 user nova-compute[80928]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 16 06:12:59 user nova-compute[80928]:     return func(*args, **kwargs)
Nov 16 06:12:59 user nova-compute[80928]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 16 06:12:59 user nova-compute[80928]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 16 06:12:59 user nova-compute[80928]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 16 06:12:59 user nova-compute[80928]:     return putils.execute(on_execute=on_execute,
Nov 16 06:12:59 user nova-compute[80928]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 16 06:12:59 user nova-compute[80928]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 16 06:12:59 user nova-compute[80928]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 16 06:12:59 user nova-compute[80928]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 16 06:12:59 user nova-compute[80928]: Exit code: 21
Nov 16 06:12:59 user nova-compute[80928]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 16 06:12:59 user nova-compute[80928]: Stderr: ''
Nov 16 06:12:59 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dfb0eb-4e91-4982-908b-a8cb08bb0480]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 16 06:12:59 user nova-compute[80928]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 16 06:12:59 user nova-compute[80928]: Exit code: 21
Nov 16 06:12:59 user nova-compute[80928]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 16 06:12:59 user nova-compute[80928]: Stderr: ''
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 16 06:12:59 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi 
Nov 16 06:12:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=80928) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.034s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] <== disconnect_volume: return (35ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:12:59 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Deleting instance files /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e_del
Nov 16 06:12:59 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Deletion of /opt/stack/data/nova/instances/adea89d7-7687-4b12-b14e-f6728191f49e_del complete
Nov 16 06:12:59 user nova-compute[80928]: INFO nova.compute.manager [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 06:12:59 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:12:59 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:13:00 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:13:00 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Took 0.80 seconds to deallocate network for instance.
Nov 16 06:13:00 user nova-compute[80928]: WARNING nova.volume.cinder [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Attachment 3d432d3f-b9a5-4376-a3e7-aa2b7d9a0a0a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3d432d3f-b9a5-4376-a3e7-aa2b7d9a0a0a. (HTTP 404) (Request-ID: req-e06d98ba-9e42-4678-b492-6482d140bb39)
Nov 16 06:13:00 user nova-compute[80928]: INFO nova.compute.manager [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Took 0.02 seconds to detach 1 volumes for instance.
Nov 16 06:13:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:13:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:13:00 user nova-compute[80928]: DEBUG nova.compute.manager [req-cbcf272b-bb3a-4913-93c7-1fe6df74283a req-4cfa2450-abde-4440-bb88-cb660d192c0d service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Received event network-vif-deleted-b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:13:00 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:13:00 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:13:00 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:13:00 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Deleted allocations for instance adea89d7-7687-4b12-b14e-f6728191f49e
Nov 16 06:13:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-3f935605-2bcc-49bb-a1de-c95a42a523b1 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "adea89d7-7687-4b12-b14e-f6728191f49e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.049s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:13:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-8604c91e-9c29-4e50-a860-c46d6891d3e8 req-65a182ae-28db-409f-99d1-334cf1347428 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Received event network-vif-plugged-b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:13:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8604c91e-9c29-4e50-a860-c46d6891d3e8 req-65a182ae-28db-409f-99d1-334cf1347428 service nova] Acquiring lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:13:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8604c91e-9c29-4e50-a860-c46d6891d3e8 req-65a182ae-28db-409f-99d1-334cf1347428 service nova] Lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:13:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8604c91e-9c29-4e50-a860-c46d6891d3e8 req-65a182ae-28db-409f-99d1-334cf1347428 service nova] Lock "adea89d7-7687-4b12-b14e-f6728191f49e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:13:01 user nova-compute[80928]: DEBUG nova.compute.manager [req-8604c91e-9c29-4e50-a860-c46d6891d3e8 req-65a182ae-28db-409f-99d1-334cf1347428 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] No waiting events found dispatching network-vif-plugged-b3cf98db-2067-4508-b968-60bd9c94d4b1 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:13:01 user nova-compute[80928]: WARNING nova.compute.manager [req-8604c91e-9c29-4e50-a860-c46d6891d3e8 req-65a182ae-28db-409f-99d1-334cf1347428 service nova] [instance: adea89d7-7687-4b12-b14e-f6728191f49e] Received unexpected event network-vif-plugged-b3cf98db-2067-4508-b968-60bd9c94d4b1 for instance with vm_state deleted and task_state None.
Nov 16 06:13:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:13:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:13:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:20 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:13:23 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:13:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:13:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:29 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:13:30 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:13:33 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:13:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:13:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:13:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:13:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:13:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:35 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:13:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:13:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:13:35 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:13:35 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:13:36 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:13:36 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:13:36 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=9150MB free_disk=25.258163452148438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:13:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:13:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:13:36 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:13:36 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:13:36 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:13:36 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:13:36 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:13:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:13:38 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:13:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:13:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:13:39 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 06:13:40 user nova-compute[80928]: INFO nova.compute.claims [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Claim successful on node user
Nov 16 06:13:40 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG nova.network.neutron [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 06:13:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 06:13:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG nova.policy [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9f5bace66414d8e8afff94043028c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc549bcee377449aa6c8a52b08287394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 06:13:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Creating image(s)
Nov 16 06:13:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "/opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "/opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.202s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:13:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk 1073741824" returned: 0 in 0.057s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG nova.network.neutron [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Successfully created port: b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.208s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Cannot resize image /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Ensure instance console log exists: /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:13:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.network.neutron [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Successfully updated port: b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquired lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.network.neutron [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-4ba70664-e5c0-4c0d-b963-015ede0012af req-b62a0d1c-f3f6-4595-bc08-15c5b8add504 service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Received event network-changed-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.compute.manager [req-4ba70664-e5c0-4c0d-b963-015ede0012af req-b62a0d1c-f3f6-4595-bc08-15c5b8add504 service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Refreshing instance network info cache due to event network-changed-b69c56e6-a08e-4f3f-880b-8f1ad01cc485. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4ba70664-e5c0-4c0d-b963-015ede0012af req-b62a0d1c-f3f6-4595-bc08-15c5b8add504 service nova] Acquiring lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.network.neutron [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Skipping network cache update for instance because it is Building. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.network.neutron [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Updating instance_info_cache with network_info: [{"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Releasing lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Instance network_info: |[{"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4ba70664-e5c0-4c0d-b963-015ede0012af req-b62a0d1c-f3f6-4595-bc08-15c5b8add504 service nova] Acquired lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.network.neutron [req-4ba70664-e5c0-4c0d-b963-015ede0012af req-b62a0d1c-f3f6-4595-bc08-15c5b8add504 service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Refreshing network info cache for port b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Start _get_guest_xml network_info=[{"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 06:13:42 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:13:42 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:13:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-823961326',display_name='tempest-VolumesSnapshotTestJSON-instance-823961326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-823961326',id=51,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfPC5b76U6vZ8mqUQKWU2vBISVQMUpqJtgFJ9NX4gAjtKHUym1WMSfDszoVe+oC3r28SzixX7FLVO18h2+/sC8+1ShE9kxqtMyBzglnBtQZuGKljMCVQ7qcAHCYPmXMQ==',key_name='tempest-keypair-1148296409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc549bcee377449aa6c8a52b08287394',ramdisk_id='',reservation_id='r-d73cc2f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1184312540',owner_user_name='tempest-VolumesSnapshotTestJSON-1184312540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f5bace66414d8e8afff94043028c7b',uuid=2d3c4a52-4e5e-4342-bcc8-e2e55e40a061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Converting VIF {"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=b69c56e6-a08e-4f3f-880b-8f1ad01cc485,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69c56e6-a0') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.objects.instance [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:13:42 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] End _get_guest_xml xml=<domain type="kvm">
Nov 16 06:13:42 user nova-compute[80928]:   <uuid>2d3c4a52-4e5e-4342-bcc8-e2e55e40a061</uuid>
Nov 16 06:13:42 user nova-compute[80928]:   <name>instance-00000033</name>
Nov 16 06:13:42 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 06:13:42 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 06:13:42 user nova-compute[80928]:   <metadata>
Nov 16 06:13:42 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 06:13:42 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 06:13:42 user nova-compute[80928]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-823961326</nova:name>
Nov 16 06:13:42 user nova-compute[80928]:       <nova:creationTime>2023-11-16 06:13:42</nova:creationTime>
Nov 16 06:13:42 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 06:13:42 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 06:13:42 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 06:13:42 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 06:13:42 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 06:13:42 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 06:13:42 user nova-compute[80928]:       </nova:flavor>
Nov 16 06:13:42 user nova-compute[80928]:       <nova:owner>
Nov 16 06:13:42 user nova-compute[80928]:         <nova:user uuid="b9f5bace66414d8e8afff94043028c7b">tempest-VolumesSnapshotTestJSON-1184312540-project-member</nova:user>
Nov 16 06:13:42 user nova-compute[80928]:         <nova:project uuid="cc549bcee377449aa6c8a52b08287394">tempest-VolumesSnapshotTestJSON-1184312540</nova:project>
Nov 16 06:13:42 user nova-compute[80928]:       </nova:owner>
Nov 16 06:13:42 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 06:13:42 user nova-compute[80928]:       <nova:ports>
Nov 16 06:13:42 user nova-compute[80928]:         <nova:port uuid="b69c56e6-a08e-4f3f-880b-8f1ad01cc485">
Nov 16 06:13:42 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 06:13:42 user nova-compute[80928]:         </nova:port>
Nov 16 06:13:42 user nova-compute[80928]:       </nova:ports>
Nov 16 06:13:42 user nova-compute[80928]:     </nova:instance>
Nov 16 06:13:42 user nova-compute[80928]:   </metadata>
Nov 16 06:13:42 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 06:13:42 user nova-compute[80928]:     <system>
Nov 16 06:13:42 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 06:13:42 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 06:13:42 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 06:13:42 user nova-compute[80928]:       <entry name="serial">2d3c4a52-4e5e-4342-bcc8-e2e55e40a061</entry>
Nov 16 06:13:42 user nova-compute[80928]:       <entry name="uuid">2d3c4a52-4e5e-4342-bcc8-e2e55e40a061</entry>
Nov 16 06:13:42 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 06:13:42 user nova-compute[80928]:     </system>
Nov 16 06:13:42 user nova-compute[80928]:   </sysinfo>
Nov 16 06:13:42 user nova-compute[80928]:   <os>
Nov 16 06:13:42 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 06:13:42 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 06:13:42 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 06:13:42 user nova-compute[80928]:   </os>
Nov 16 06:13:42 user nova-compute[80928]:   <features>
Nov 16 06:13:42 user nova-compute[80928]:     <acpi/>
Nov 16 06:13:42 user nova-compute[80928]:     <apic/>
Nov 16 06:13:42 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 06:13:42 user nova-compute[80928]:   </features>
Nov 16 06:13:42 user nova-compute[80928]:   <clock offset="utc">
Nov 16 06:13:42 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 06:13:42 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 06:13:42 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 06:13:42 user nova-compute[80928]:   </clock>
Nov 16 06:13:42 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 06:13:42 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 06:13:42 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 06:13:42 user nova-compute[80928]:   </cpu>
Nov 16 06:13:42 user nova-compute[80928]:   <devices>
Nov 16 06:13:42 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 06:13:42 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 06:13:42 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk"/>
Nov 16 06:13:42 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 06:13:42 user nova-compute[80928]:     </disk>
Nov 16 06:13:42 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 06:13:42 user nova-compute[80928]:       <mac address="fa:16:3e:8b:b4:f6"/>
Nov 16 06:13:42 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:13:42 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 06:13:42 user nova-compute[80928]:       <target dev="tapb69c56e6-a0"/>
Nov 16 06:13:42 user nova-compute[80928]:     </interface>
Nov 16 06:13:42 user nova-compute[80928]:     <serial type="pty">
Nov 16 06:13:42 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/console.log" append="off"/>
Nov 16 06:13:42 user nova-compute[80928]:     </serial>
Nov 16 06:13:42 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 06:13:42 user nova-compute[80928]:     <video>
Nov 16 06:13:42 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:13:42 user nova-compute[80928]:     </video>
Nov 16 06:13:42 user nova-compute[80928]:     <rng model="virtio">
Nov 16 06:13:42 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 06:13:42 user nova-compute[80928]:     </rng>
Nov 16 06:13:42 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 06:13:42 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 06:13:42 user nova-compute[80928]:       <stats period="10"/>
Nov 16 06:13:42 user nova-compute[80928]:     </memballoon>
Nov 16 06:13:42 user nova-compute[80928]:   </devices>
Nov 16 06:13:42 user nova-compute[80928]: </domain>
Nov 16 06:13:42 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:13:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-823961326',display_name='tempest-VolumesSnapshotTestJSON-instance-823961326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-823961326',id=51,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfPC5b76U6vZ8mqUQKWU2vBISVQMUpqJtgFJ9NX4gAjtKHUym1WMSfDszoVe+oC3r28SzixX7FLVO18h2+/sC8+1ShE9kxqtMyBzglnBtQZuGKljMCVQ7qcAHCYPmXMQ==',key_name='tempest-keypair-1148296409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc549bcee377449aa6c8a52b08287394',ramdisk_id='',reservation_id='r-d73cc2f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1184312540',owner_user_name='tempest-VolumesSnapshotTestJSON-1184312540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f5bace66414d8e8afff94043028c7b',uuid=2d3c4a52-4e5e-4342-bcc8-e2e55e40a061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Converting VIF {"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=b69c56e6-a08e-4f3f-880b-8f1ad01cc485,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69c56e6-a0') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG os_vif [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=b69c56e6-a08e-4f3f-880b-8f1ad01cc485,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69c56e6-a0') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a342d28b-64d6-5392-ba91-a4325b798e7a', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb69c56e6-a0, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb69c56e6-a0, col_values=(('qos', UUID('25c6f7bf-31de-40f0-8ea8-aea763dfa658')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb69c56e6-a0, col_values=(('external_ids', {'iface-id': 'b69c56e6-a08e-4f3f-880b-8f1ad01cc485', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:b4:f6', 'vm-uuid': '2d3c4a52-4e5e-4342-bcc8-e2e55e40a061'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:43 user nova-compute[80928]: INFO os_vif [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=b69c56e6-a08e-4f3f-880b-8f1ad01cc485,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69c56e6-a0')
Nov 16 06:13:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] No VIF found with MAC fa:16:3e:8b:b4:f6, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG nova.network.neutron [req-4ba70664-e5c0-4c0d-b963-015ede0012af req-b62a0d1c-f3f6-4595-bc08-15c5b8add504 service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Updated VIF entry in instance network info cache for port b69c56e6-a08e-4f3f-880b-8f1ad01cc485. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG nova.network.neutron [req-4ba70664-e5c0-4c0d-b963-015ede0012af req-b62a0d1c-f3f6-4595-bc08-15c5b8add504 service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Updating instance_info_cache with network_info: [{"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:13:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4ba70664-e5c0-4c0d-b963-015ede0012af req-b62a0d1c-f3f6-4595-bc08-15c5b8add504 service nova] Releasing lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:13:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-6d4a2672-7c53-4a25-9020-bec268ecd039 req-6ff56872-5d46-4d15-8b2c-e35777ae36dd service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Received event network-vif-plugged-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:13:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6d4a2672-7c53-4a25-9020-bec268ecd039 req-6ff56872-5d46-4d15-8b2c-e35777ae36dd service nova] Acquiring lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:13:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6d4a2672-7c53-4a25-9020-bec268ecd039 req-6ff56872-5d46-4d15-8b2c-e35777ae36dd service nova] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:13:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6d4a2672-7c53-4a25-9020-bec268ecd039 req-6ff56872-5d46-4d15-8b2c-e35777ae36dd service nova] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:13:44 user nova-compute[80928]: DEBUG nova.compute.manager [req-6d4a2672-7c53-4a25-9020-bec268ecd039 req-6ff56872-5d46-4d15-8b2c-e35777ae36dd service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] No waiting events found dispatching network-vif-plugged-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:13:44 user nova-compute[80928]: WARNING nova.compute.manager [req-6d4a2672-7c53-4a25-9020-bec268ecd039 req-6ff56872-5d46-4d15-8b2c-e35777ae36dd service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Received unexpected event network-vif-plugged-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 for instance with vm_state building and task_state spawning.
Nov 16 06:13:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 06:13:46 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Instance spawned successfully.
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:13:46 user nova-compute[80928]: INFO nova.compute.manager [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.compute.manager [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:46 user nova-compute[80928]: INFO nova.compute.manager [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Took 6.59 seconds to build instance.
Nov 16 06:13:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1c1-bf58-45d8-9459-1120dc46434c tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.687s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-35d4ac3c-4b70-4d26-9d56-d79bcec70ba8 req-0796dd3b-6303-412a-8c5b-44f90fe6daad service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Received event network-vif-plugged-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-35d4ac3c-4b70-4d26-9d56-d79bcec70ba8 req-0796dd3b-6303-412a-8c5b-44f90fe6daad service nova] Acquiring lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-35d4ac3c-4b70-4d26-9d56-d79bcec70ba8 req-0796dd3b-6303-412a-8c5b-44f90fe6daad service nova] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-35d4ac3c-4b70-4d26-9d56-d79bcec70ba8 req-0796dd3b-6303-412a-8c5b-44f90fe6daad service nova] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:13:46 user nova-compute[80928]: DEBUG nova.compute.manager [req-35d4ac3c-4b70-4d26-9d56-d79bcec70ba8 req-0796dd3b-6303-412a-8c5b-44f90fe6daad service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] No waiting events found dispatching network-vif-plugged-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:13:46 user nova-compute[80928]: WARNING nova.compute.manager [req-35d4ac3c-4b70-4d26-9d56-d79bcec70ba8 req-0796dd3b-6303-412a-8c5b-44f90fe6daad service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Received unexpected event network-vif-plugged-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 for instance with vm_state active and task_state None.
Nov 16 06:13:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:13:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:21 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:14:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:23 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:14:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:31 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:14:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:14:33 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:14:37 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:14:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:14:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:14:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:14:37 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:14:37 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:14:38 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:14:38 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:14:38 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=25.220718383789062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:14:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:14:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:14:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:14:43 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:14:43 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:14:43 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:14:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:14:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:14:43 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:14:43 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:14:44 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Updating instance_info_cache with network_info: [{"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:14:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:14:44 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:14:44 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:14:46 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:14:46 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:14:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:14:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:14:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:15:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:15:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:22 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:15:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:23 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:15:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:15:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:15:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:15:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:15:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-4a686b3f-a093-4401-9608-21ebaca17c52 req-92b9af3e-a0f5-40f1-9b26-d7525a91067c service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Received event network-changed-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:15:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-4a686b3f-a093-4401-9608-21ebaca17c52 req-92b9af3e-a0f5-40f1-9b26-d7525a91067c service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Refreshing instance network info cache due to event network-changed-b69c56e6-a08e-4f3f-880b-8f1ad01cc485. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:15:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4a686b3f-a093-4401-9608-21ebaca17c52 req-92b9af3e-a0f5-40f1-9b26-d7525a91067c service nova] Acquiring lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:15:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4a686b3f-a093-4401-9608-21ebaca17c52 req-92b9af3e-a0f5-40f1-9b26-d7525a91067c service nova] Acquired lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:15:31 user nova-compute[80928]: DEBUG nova.network.neutron [req-4a686b3f-a093-4401-9608-21ebaca17c52 req-92b9af3e-a0f5-40f1-9b26-d7525a91067c service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Refreshing network info cache for port b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:15:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:15:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:15:31 user nova-compute[80928]: DEBUG nova.objects.instance [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lazy-loading 'flavor' on Instance uuid 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:15:31 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Ignoring supplied device name: /dev/vdb
Nov 16 06:15:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:15:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:15:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:15:31 user nova-compute[80928]: INFO nova.compute.manager [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Attaching volume 40527398-67ad-4e2a-8508-b65d0e6c1008 to /dev/vdb
Nov 16 06:15:31 user nova-compute[80928]: DEBUG os_brick.utils [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:15:31 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[331714ca-5ccf-47c4-b167-ce265b35f001]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b129f6-557f-46fc-86ab-9cf37573f43e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c2bbc4-8c23-4e25-b8f6-c8bfe1362686]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd59f9a4-3437-464e-8a71-22006f543118]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG nova.network.neutron [req-4a686b3f-a093-4401-9608-21ebaca17c52 req-92b9af3e-a0f5-40f1-9b26-d7525a91067c service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Updated VIF entry in instance network info cache for port b69c56e6-a08e-4f3f-880b-8f1ad01cc485. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG nova.network.neutron [req-4a686b3f-a093-4401-9608-21ebaca17c52 req-92b9af3e-a0f5-40f1-9b26-d7525a91067c service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Updating instance_info_cache with network_info: [{"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:15:32 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[855168bc-5c67-44f9-bd6e-a9963f461165]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG os_brick.utils [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Updating existing volume attachment record: 71f1d06c-d3b4-4e18-bf49-5ea91279497d {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-4a686b3f-a093-4401-9608-21ebaca17c52 req-92b9af3e-a0f5-40f1-9b26-d7525a91067c service nova] Releasing lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:15:32 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:15:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:33 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:15:35 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:15:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGSwrDLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:15:38 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:15:38 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:15:38 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[551436f5-1ffd-420b-8d0f-9199f6b04123]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:15:38 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97b1291-da94-4176-8eb2-9275f7698829]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008] added
Nov 16 06:15:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c444c985-f440-41d4-91c1-3cc29f0703fe]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[27148da4-b38c-4a82-a034-edab033ec4e5]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGSwrDLb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGSwrDLb" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c45df09-8b8a-4887-8120-9d056229e717]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vGSwrDLb'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9162626-83fa-428a-8b25-f9a6629794f6]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad585efc-2f52-4d17-abb9-31588c4904c9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:15:38 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:15:38 user nova-compute[80928]:  {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:15:38 user nova-compute[80928]: WARNING os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 06:15:38 user nova-compute[80928]: 
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[da520f4c-5fcb-4703-a9c3-9e4d266a5123]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008, portal: 172.16.0.220,3260]
Nov 16 06:15:38 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008, portal: 172.16.0.220,3260] successful.
Nov 16 06:15:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[00989326-46b9-448c-8151-e4cdd26cc053]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c2146f-16b6-48f3-a8ca-31a04403ed79]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 (non-flash)
Nov 16 06:15:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 (non-flash)
Nov 16 06:15:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22d3cf9-da77-4ede-b517-d5542e355ec1]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGSwrDLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:15:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.536s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] <== connect_volume: return (1538ms) {'type': 'block', 'scsi_wwn': '26335656361626564', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335656361626564', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:15:39 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:15:39 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:15:39 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=25.21988296508789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG nova.objects.instance [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lazy-loading 'flavor' on Instance uuid 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 06:15:39 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:15:39 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:15:39 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:15:39 user nova-compute[80928]:   <serial>40527398-67ad-4e2a-8508-b65d0e6c1008</serial>
Nov 16 06:15:39 user nova-compute[80928]: </disk>
Nov 16 06:15:39 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing inventories for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating ProviderTree inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing aggregate associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, aggregates: None {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 06:15:39 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing trait associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 06:15:40 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:15:40 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:15:40 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:15:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:15:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:15:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:15:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] No VIF found with MAC fa:16:3e:8b:b4:f6, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:15:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8bd488ad-d42e-47d5-bee2-9d6cee7832ff tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.319s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:15:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:42 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:15:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:44 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:15:44 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:15:44 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:15:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:15:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:15:44 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:15:44 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:15:45 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Updating instance_info_cache with network_info: [{"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:15:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:15:45 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:15:45 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:15:45 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:15:45 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances with incomplete migration  {{(pid=80928) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 06:15:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:47 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:15:47 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:15:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:15:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:15:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:15:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:15:51 user nova-compute[80928]: INFO nova.compute.manager [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Detaching volume 40527398-67ad-4e2a-8508-b65d0e6c1008
Nov 16 06:15:51 user nova-compute[80928]: INFO nova.virt.block_device [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Attempting to driver detach volume 40527398-67ad-4e2a-8508-b65d0e6c1008 from mountpoint /dev/vdb
Nov 16 06:15:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Attempting to detach device vdb from instance 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 06:15:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:15:51 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:15:51 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:15:51 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:15:51 user nova-compute[80928]:   <serial>40527398-67ad-4e2a-8508-b65d0e6c1008</serial>
Nov 16 06:15:51 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:15:51 user nova-compute[80928]: </disk>
Nov 16 06:15:51 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:15:51 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Successfully detached device vdb from instance 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 from the persistent domain config.
Nov 16 06:15:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 06:15:51 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:15:51 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:15:51 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:15:51 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:15:51 user nova-compute[80928]:   <serial>40527398-67ad-4e2a-8508-b65d0e6c1008</serial>
Nov 16 06:15:51 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:15:51 user nova-compute[80928]: </disk>
Nov 16 06:15:51 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:15:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:15:52 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 06:15:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:15:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:16:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:06 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:16:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 06:16:06 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] There are 0 instances to clean {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 06:16:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:12 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 is timed out.
Nov 16 06:16:12 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Successfully detached device vdb from instance 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 from the live domain config.
Nov 16 06:16:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGSwrDLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:16:12 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d5e23d-0348-4d29-9164-729a1fee0205]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:16:12 user nova-compute[80928]: No targets found.
Nov 16 06:16:12 user nova-compute[80928]: iSNS:
Nov 16 06:16:12 user nova-compute[80928]: No targets found.
Nov 16 06:16:12 user nova-compute[80928]: STATIC:
Nov 16 06:16:12 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008
Nov 16 06:16:12 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:16:12 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:16:12 user nova-compute[80928]: FIRMWARE:
Nov 16 06:16:12 user nova-compute[80928]: No targets found.
Nov 16 06:16:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:16:12 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:16:12 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d13cae-9035-4128-9640-2fec66ed0c10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cababd-6cba-4a49-961a-85a4690c8c35]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 (non-flash)
Nov 16 06:16:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 (non-flash)
Nov 16 06:16:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8658259750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54eb903-abfb-4c9d-b9f3-8263fda6df48]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf7b574-b150-4aaa-a406-96b2412f6be5]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce18a8c-01c6-4fa7-bb31-cefd6b634076]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2a05fd-6bfa-4ff7-a5f0-b634d60b56be]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8ec2f2-c0fa-461f-8712-0ce2b6b0f199]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[007316a1-d218-441f-a45b-0e8d373f6402]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008, portal: 172.16.0.220,3260]
Nov 16 06:16:12 user nova-compute[80928]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008, portal: 172.16.0.220,3260] successful.
Nov 16 06:16:12 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49ce2f0-ca51-4bef-a967-84a4baff6f8e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] <== disconnect_volume: return (277ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:16:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG nova.objects.instance [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lazy-loading 'flavor' on Instance uuid 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-aa62bde4-0692-481d-8f97-944fe8c35cbb tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.720s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.604s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:16:13 user nova-compute[80928]: INFO nova.compute.manager [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Terminating instance
Nov 16 06:16:13 user nova-compute[80928]: DEBUG nova.compute.manager [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-253977fb-aa6b-43e8-86b7-1f0847cd5cfe req-f81f0fb3-61fa-4964-a9a7-7537320ecb5c service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Received event network-vif-unplugged-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-253977fb-aa6b-43e8-86b7-1f0847cd5cfe req-f81f0fb3-61fa-4964-a9a7-7537320ecb5c service nova] Acquiring lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-253977fb-aa6b-43e8-86b7-1f0847cd5cfe req-f81f0fb3-61fa-4964-a9a7-7537320ecb5c service nova] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-253977fb-aa6b-43e8-86b7-1f0847cd5cfe req-f81f0fb3-61fa-4964-a9a7-7537320ecb5c service nova] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-253977fb-aa6b-43e8-86b7-1f0847cd5cfe req-f81f0fb3-61fa-4964-a9a7-7537320ecb5c service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] No waiting events found dispatching network-vif-unplugged-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG nova.compute.manager [req-253977fb-aa6b-43e8-86b7-1f0847cd5cfe req-f81f0fb3-61fa-4964-a9a7-7537320ecb5c service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Received event network-vif-unplugged-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:16:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Instance destroyed successfully.
Nov 16 06:16:14 user nova-compute[80928]: DEBUG nova.objects.instance [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lazy-loading 'resources' on Instance uuid 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:13:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-823961326',display_name='tempest-VolumesSnapshotTestJSON-instance-823961326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-823961326',id=51,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfPC5b76U6vZ8mqUQKWU2vBISVQMUpqJtgFJ9NX4gAjtKHUym1WMSfDszoVe+oC3r28SzixX7FLVO18h2+/sC8+1ShE9kxqtMyBzglnBtQZuGKljMCVQ7qcAHCYPmXMQ==',key_name='tempest-keypair-1148296409',keypairs=<?>,launch_index=0,launched_at=2023-11-16T06:13:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc549bcee377449aa6c8a52b08287394',ramdisk_id='',reservation_id='r-d73cc2f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1184312540',owner_user_name='tempest-VolumesSnapshotTestJSON-1184312540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T06:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f5bace66414d8e8afff94043028c7b',uuid=2d3c4a52-4e5e-4342-bcc8-e2e55e40a061,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Converting VIF {"id": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "address": "fa:16:3e:8b:b4:f6", "network": {"id": "ff30f537-e651-483e-9a05-78d203abe9de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1034763427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc549bcee377449aa6c8a52b08287394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69c56e6-a0", "ovs_interfaceid": "b69c56e6-a08e-4f3f-880b-8f1ad01cc485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=b69c56e6-a08e-4f3f-880b-8f1ad01cc485,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69c56e6-a0') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG os_vif [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=b69c56e6-a08e-4f3f-880b-8f1ad01cc485,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69c56e6-a0') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb69c56e6-a0, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25c6f7bf-31de-40f0-8ea8-aea763dfa658) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:16:14 user nova-compute[80928]: INFO os_vif [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=b69c56e6-a08e-4f3f-880b-8f1ad01cc485,network=Network(ff30f537-e651-483e-9a05-78d203abe9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69c56e6-a0')
Nov 16 06:16:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:40527398-67ad-4e2a-8508-b65d0e6c1008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGSwrDLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:16:14 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:16:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a488a49e-1342-4524-a7aa-92bc4c9f20ec]: Unexpected error while running command.
Nov 16 06:16:14 user nova-compute[80928]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 16 06:16:14 user nova-compute[80928]: Exit code: 21
Nov 16 06:16:14 user nova-compute[80928]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 16 06:16:14 user nova-compute[80928]: Stderr: '' {{(pid=92262) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 16 06:16:14 user nova-compute[80928]: Traceback (most recent call last):
Nov 16 06:16:14 user nova-compute[80928]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 16 06:16:14 user nova-compute[80928]:     ret = func(*f_args, **f_kwargs)
Nov 16 06:16:14 user nova-compute[80928]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 16 06:16:14 user nova-compute[80928]:     return func(*args, **kwargs)
Nov 16 06:16:14 user nova-compute[80928]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 16 06:16:14 user nova-compute[80928]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 16 06:16:14 user nova-compute[80928]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 16 06:16:14 user nova-compute[80928]:     return putils.execute(on_execute=on_execute,
Nov 16 06:16:14 user nova-compute[80928]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 16 06:16:14 user nova-compute[80928]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 16 06:16:14 user nova-compute[80928]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 16 06:16:14 user nova-compute[80928]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 16 06:16:14 user nova-compute[80928]: Exit code: 21
Nov 16 06:16:14 user nova-compute[80928]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 16 06:16:14 user nova-compute[80928]: Stderr: ''
Nov 16 06:16:14 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a488a49e-1342-4524-a7aa-92bc4c9f20ec]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 16 06:16:14 user nova-compute[80928]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 16 06:16:14 user nova-compute[80928]: Exit code: 21
Nov 16 06:16:14 user nova-compute[80928]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 16 06:16:14 user nova-compute[80928]: Stderr: ''
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 16 06:16:14 user nova-compute[80928]: ERROR os_brick.initiator.connectors.iscsi 
Nov 16 06:16:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=80928) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.022s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] <== disconnect_volume: return (23ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:16:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Deleting instance files /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061_del
Nov 16 06:16:14 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Deletion of /opt/stack/data/nova/instances/2d3c4a52-4e5e-4342-bcc8-e2e55e40a061_del complete
Nov 16 06:16:14 user nova-compute[80928]: INFO nova.compute.manager [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 06:16:14 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:16:14 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:16:15 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:16:15 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Took 0.68 seconds to deallocate network for instance.
Nov 16 06:16:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-2ed62681-e40d-4354-97e6-69c69fb5fd99 req-471a42f5-6d76-410f-9118-44e45eaf356d service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Received event network-vif-deleted-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:16:15 user nova-compute[80928]: WARNING nova.volume.cinder [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Attachment 71f1d06c-d3b4-4e18-bf49-5ea91279497d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 71f1d06c-d3b4-4e18-bf49-5ea91279497d. (HTTP 404) (Request-ID: req-b758d1f0-760c-4429-9f44-8b216aa8326b)
Nov 16 06:16:15 user nova-compute[80928]: INFO nova.compute.manager [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Took 0.03 seconds to detach 1 volumes for instance.
Nov 16 06:16:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:16:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:16:15 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:16:15 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:16:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:16:15 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Deleted allocations for instance 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061
Nov 16 06:16:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-76be22ed-bcf5-4469-beaf-a93c6fd565b9 tempest-VolumesSnapshotTestJSON-1184312540 tempest-VolumesSnapshotTestJSON-1184312540-project-member] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.934s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:16:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-0e6a7a7d-295b-4a68-9e92-ad67f70d4866 req-b0f5d6dc-dd1d-4422-8fb8-189da5bc0565 service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Received event network-vif-plugged-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:16:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0e6a7a7d-295b-4a68-9e92-ad67f70d4866 req-b0f5d6dc-dd1d-4422-8fb8-189da5bc0565 service nova] Acquiring lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:16:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0e6a7a7d-295b-4a68-9e92-ad67f70d4866 req-b0f5d6dc-dd1d-4422-8fb8-189da5bc0565 service nova] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:16:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-0e6a7a7d-295b-4a68-9e92-ad67f70d4866 req-b0f5d6dc-dd1d-4422-8fb8-189da5bc0565 service nova] Lock "2d3c4a52-4e5e-4342-bcc8-e2e55e40a061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:16:15 user nova-compute[80928]: DEBUG nova.compute.manager [req-0e6a7a7d-295b-4a68-9e92-ad67f70d4866 req-b0f5d6dc-dd1d-4422-8fb8-189da5bc0565 service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] No waiting events found dispatching network-vif-plugged-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:16:15 user nova-compute[80928]: WARNING nova.compute.manager [req-0e6a7a7d-295b-4a68-9e92-ad67f70d4866 req-b0f5d6dc-dd1d-4422-8fb8-189da5bc0565 service nova] [instance: 2d3c4a52-4e5e-4342-bcc8-e2e55e40a061] Received unexpected event network-vif-plugged-b69c56e6-a08e-4f3f-880b-8f1ad01cc485 for instance with vm_state deleted and task_state None.
Nov 16 06:16:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:16:24 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:16:24 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:16:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:16:32 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_power_states {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:16:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:16:34 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:16:36 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:16:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:16:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:16:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:16:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:16:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:16:39 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:16:40 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:16:40 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:16:40 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=9122MB free_disk=25.24676513671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:16:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:16:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:16:40 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:16:40 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:16:40 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:16:40 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:16:40 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:16:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:16:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:16:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:16:45 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:16:45 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:16:45 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:16:45 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 06:16:46 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:16:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:16:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:16:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:16:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:16:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:16:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:16:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:16:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:16:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:17:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:17:12 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:24 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:17:25 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:17:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 06:17:27 user nova-compute[80928]: INFO nova.compute.claims [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Claim successful on node user
Nov 16 06:17:27 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 06:17:27 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 06:17:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG nova.policy [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '592f4db4b7164cbfacefe4f0c03dbeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2728893eb13a43b08036aeb4e38e6a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 06:17:27 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Creating image(s)
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "/opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "/opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "/opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:17:27 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk 1073741824" returned: 0 in 0.067s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.195s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Successfully created port: 56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Cannot resize image /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Ensure instance console log exists: /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:17:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Successfully updated port: 56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquired lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-32c7b8c8-3049-45d7-b042-094112c4578a req-833800d7-c4de-412d-9e4c-93aebe25114c service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Received event network-changed-56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.compute.manager [req-32c7b8c8-3049-45d7-b042-094112c4578a req-833800d7-c4de-412d-9e4c-93aebe25114c service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Refreshing instance network info cache due to event network-changed-56007ef9-c855-43e3-86a5-327844116fe1. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-32c7b8c8-3049-45d7-b042-094112c4578a req-833800d7-c4de-412d-9e4c-93aebe25114c service nova] Acquiring lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.network.neutron [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updating instance_info_cache with network_info: [{"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Releasing lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Instance network_info: |[{"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-32c7b8c8-3049-45d7-b042-094112c4578a req-833800d7-c4de-412d-9e4c-93aebe25114c service nova] Acquired lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-32c7b8c8-3049-45d7-b042-094112c4578a req-833800d7-c4de-412d-9e4c-93aebe25114c service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Refreshing network info cache for port 56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Start _get_guest_xml network_info=[{"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 06:17:29 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:17:29 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-546244839',display_name='tempest-TestServerVolumeAttachmentScenario-server-546244839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-546244839',id=52,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiq9crj0rlLo1CY4r/fvWP4Ofm2LQRcqXJMbKoJcUmOYcXd9fR6+YHeU2I1C4+0sNI8be4iYGhiENXFVH0o0c7MfPX2wxwTUIgOC5xOHmJsXUBpq6OgeQ0yiSfKmTUgyQ==',key_name='tempest-keypair-1161425848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2728893eb13a43b08036aeb4e38e6a3a',ramdisk_id='',reservation_id='r-z6fj78v1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-50594187',owner_user_name='tempest-TestServerVolumeAttachmentScenario-50594187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:17:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='592f4db4b7164cbfacefe4f0c03dbeec',uuid=4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Converting VIF {"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:bd:cd,bridge_name='br-int',has_traffic_filtering=True,id=56007ef9-c855-43e3-86a5-327844116fe1,network=Network(033dcef7-376a-4a0e-822c-d9fe63f70bc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56007ef9-c8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.objects.instance [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lazy-loading 'pci_devices' on Instance uuid 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 06:17:29 user nova-compute[80928]:   <uuid>4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d</uuid>
Nov 16 06:17:29 user nova-compute[80928]:   <name>instance-00000034</name>
Nov 16 06:17:29 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 06:17:29 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 06:17:29 user nova-compute[80928]:   <metadata>
Nov 16 06:17:29 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 06:17:29 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 06:17:29 user nova-compute[80928]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-546244839</nova:name>
Nov 16 06:17:29 user nova-compute[80928]:       <nova:creationTime>2023-11-16 06:17:29</nova:creationTime>
Nov 16 06:17:29 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 06:17:29 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 06:17:29 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 06:17:29 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 06:17:29 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 06:17:29 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 06:17:29 user nova-compute[80928]:       </nova:flavor>
Nov 16 06:17:29 user nova-compute[80928]:       <nova:owner>
Nov 16 06:17:29 user nova-compute[80928]:         <nova:user uuid="592f4db4b7164cbfacefe4f0c03dbeec">tempest-TestServerVolumeAttachmentScenario-50594187-project-member</nova:user>
Nov 16 06:17:29 user nova-compute[80928]:         <nova:project uuid="2728893eb13a43b08036aeb4e38e6a3a">tempest-TestServerVolumeAttachmentScenario-50594187</nova:project>
Nov 16 06:17:29 user nova-compute[80928]:       </nova:owner>
Nov 16 06:17:29 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 06:17:29 user nova-compute[80928]:       <nova:ports>
Nov 16 06:17:29 user nova-compute[80928]:         <nova:port uuid="56007ef9-c855-43e3-86a5-327844116fe1">
Nov 16 06:17:29 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 06:17:29 user nova-compute[80928]:         </nova:port>
Nov 16 06:17:29 user nova-compute[80928]:       </nova:ports>
Nov 16 06:17:29 user nova-compute[80928]:     </nova:instance>
Nov 16 06:17:29 user nova-compute[80928]:   </metadata>
Nov 16 06:17:29 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 06:17:29 user nova-compute[80928]:     <system>
Nov 16 06:17:29 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 06:17:29 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 06:17:29 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 06:17:29 user nova-compute[80928]:       <entry name="serial">4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d</entry>
Nov 16 06:17:29 user nova-compute[80928]:       <entry name="uuid">4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d</entry>
Nov 16 06:17:29 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 06:17:29 user nova-compute[80928]:     </system>
Nov 16 06:17:29 user nova-compute[80928]:   </sysinfo>
Nov 16 06:17:29 user nova-compute[80928]:   <os>
Nov 16 06:17:29 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 06:17:29 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 06:17:29 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 06:17:29 user nova-compute[80928]:   </os>
Nov 16 06:17:29 user nova-compute[80928]:   <features>
Nov 16 06:17:29 user nova-compute[80928]:     <acpi/>
Nov 16 06:17:29 user nova-compute[80928]:     <apic/>
Nov 16 06:17:29 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 06:17:29 user nova-compute[80928]:   </features>
Nov 16 06:17:29 user nova-compute[80928]:   <clock offset="utc">
Nov 16 06:17:29 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 06:17:29 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 06:17:29 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 06:17:29 user nova-compute[80928]:   </clock>
Nov 16 06:17:29 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 06:17:29 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 06:17:29 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 06:17:29 user nova-compute[80928]:   </cpu>
Nov 16 06:17:29 user nova-compute[80928]:   <devices>
Nov 16 06:17:29 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 06:17:29 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 06:17:29 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk"/>
Nov 16 06:17:29 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 06:17:29 user nova-compute[80928]:     </disk>
Nov 16 06:17:29 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 06:17:29 user nova-compute[80928]:       <mac address="fa:16:3e:1f:bd:cd"/>
Nov 16 06:17:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:17:29 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 06:17:29 user nova-compute[80928]:       <target dev="tap56007ef9-c8"/>
Nov 16 06:17:29 user nova-compute[80928]:     </interface>
Nov 16 06:17:29 user nova-compute[80928]:     <serial type="pty">
Nov 16 06:17:29 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/console.log" append="off"/>
Nov 16 06:17:29 user nova-compute[80928]:     </serial>
Nov 16 06:17:29 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 06:17:29 user nova-compute[80928]:     <video>
Nov 16 06:17:29 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:17:29 user nova-compute[80928]:     </video>
Nov 16 06:17:29 user nova-compute[80928]:     <rng model="virtio">
Nov 16 06:17:29 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 06:17:29 user nova-compute[80928]:     </rng>
Nov 16 06:17:29 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 06:17:29 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 06:17:29 user nova-compute[80928]:       <stats period="10"/>
Nov 16 06:17:29 user nova-compute[80928]:     </memballoon>
Nov 16 06:17:29 user nova-compute[80928]:   </devices>
Nov 16 06:17:29 user nova-compute[80928]: </domain>
Nov 16 06:17:29 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-546244839',display_name='tempest-TestServerVolumeAttachmentScenario-server-546244839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-546244839',id=52,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiq9crj0rlLo1CY4r/fvWP4Ofm2LQRcqXJMbKoJcUmOYcXd9fR6+YHeU2I1C4+0sNI8be4iYGhiENXFVH0o0c7MfPX2wxwTUIgOC5xOHmJsXUBpq6OgeQ0yiSfKmTUgyQ==',key_name='tempest-keypair-1161425848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2728893eb13a43b08036aeb4e38e6a3a',ramdisk_id='',reservation_id='r-z6fj78v1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-50594187',owner_user_name='tempest-TestServerVolumeAttachmentScenario-50594187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:17:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='592f4db4b7164cbfacefe4f0c03dbeec',uuid=4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Converting VIF {"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:bd:cd,bridge_name='br-int',has_traffic_filtering=True,id=56007ef9-c855-43e3-86a5-327844116fe1,network=Network(033dcef7-376a-4a0e-822c-d9fe63f70bc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56007ef9-c8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG os_vif [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:bd:cd,bridge_name='br-int',has_traffic_filtering=True,id=56007ef9-c855-43e3-86a5-327844116fe1,network=Network(033dcef7-376a-4a0e-822c-d9fe63f70bc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56007ef9-c8') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10af2624-dc99-5d6a-932f-e757d5a0185b', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56007ef9-c8, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56007ef9-c8, col_values=(('qos', UUID('385d8a01-fc15-4798-9a56-37d1c0309c9d')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56007ef9-c8, col_values=(('external_ids', {'iface-id': '56007ef9-c855-43e3-86a5-327844116fe1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:bd:cd', 'vm-uuid': '4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:29 user nova-compute[80928]: INFO os_vif [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:bd:cd,bridge_name='br-int',has_traffic_filtering=True,id=56007ef9-c855-43e3-86a5-327844116fe1,network=Network(033dcef7-376a-4a0e-822c-d9fe63f70bc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56007ef9-c8')
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] No VIF found with MAC fa:16:3e:1f:bd:cd, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-32c7b8c8-3049-45d7-b042-094112c4578a req-833800d7-c4de-412d-9e4c-93aebe25114c service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updated VIF entry in instance network info cache for port 56007ef9-c855-43e3-86a5-327844116fe1. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG nova.network.neutron [req-32c7b8c8-3049-45d7-b042-094112c4578a req-833800d7-c4de-412d-9e4c-93aebe25114c service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updating instance_info_cache with network_info: [{"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:17:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-32c7b8c8-3049-45d7-b042-094112c4578a req-833800d7-c4de-412d-9e4c-93aebe25114c service nova] Releasing lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:17:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-082f1573-371e-4647-8f6d-a18b9d640e60 req-724571ad-728a-4cd3-a9e7-2f90cb06512c service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Received event network-vif-plugged-56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:17:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-082f1573-371e-4647-8f6d-a18b9d640e60 req-724571ad-728a-4cd3-a9e7-2f90cb06512c service nova] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:17:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-082f1573-371e-4647-8f6d-a18b9d640e60 req-724571ad-728a-4cd3-a9e7-2f90cb06512c service nova] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:17:31 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-082f1573-371e-4647-8f6d-a18b9d640e60 req-724571ad-728a-4cd3-a9e7-2f90cb06512c service nova] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:17:31 user nova-compute[80928]: DEBUG nova.compute.manager [req-082f1573-371e-4647-8f6d-a18b9d640e60 req-724571ad-728a-4cd3-a9e7-2f90cb06512c service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] No waiting events found dispatching network-vif-plugged-56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:17:31 user nova-compute[80928]: WARNING nova.compute.manager [req-082f1573-371e-4647-8f6d-a18b9d640e60 req-724571ad-728a-4cd3-a9e7-2f90cb06512c service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Received unexpected event network-vif-plugged-56007ef9-c855-43e3-86a5-327844116fe1 for instance with vm_state building and task_state spawning.
Nov 16 06:17:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 06:17:33 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Instance spawned successfully.
Nov 16 06:17:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:17:33 user nova-compute[80928]: INFO nova.compute.manager [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 16 06:17:33 user nova-compute[80928]: DEBUG nova.compute.manager [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-8f4668db-f031-45a8-adb5-2fb08144b528 req-1ad59427-ea58-49bc-81ce-3c5506d1ffbc service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Received event network-vif-plugged-56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8f4668db-f031-45a8-adb5-2fb08144b528 req-1ad59427-ea58-49bc-81ce-3c5506d1ffbc service nova] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8f4668db-f031-45a8-adb5-2fb08144b528 req-1ad59427-ea58-49bc-81ce-3c5506d1ffbc service nova] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-8f4668db-f031-45a8-adb5-2fb08144b528 req-1ad59427-ea58-49bc-81ce-3c5506d1ffbc service nova] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:17:33 user nova-compute[80928]: DEBUG nova.compute.manager [req-8f4668db-f031-45a8-adb5-2fb08144b528 req-1ad59427-ea58-49bc-81ce-3c5506d1ffbc service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] No waiting events found dispatching network-vif-plugged-56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:17:33 user nova-compute[80928]: WARNING nova.compute.manager [req-8f4668db-f031-45a8-adb5-2fb08144b528 req-1ad59427-ea58-49bc-81ce-3c5506d1ffbc service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Received unexpected event network-vif-plugged-56007ef9-c855-43e3-86a5-327844116fe1 for instance with vm_state building and task_state spawning.
Nov 16 06:17:33 user nova-compute[80928]: INFO nova.compute.manager [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Took 5.91 seconds to build instance.
Nov 16 06:17:33 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-8eb7c7fa-9b07-4f62-b03c-ba2537f58551 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.013s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:17:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:35 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:17:35 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:17:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:37 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:17:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:17:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:17:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:17:39 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:17:39 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:17:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:17:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:17:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:17:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:17:40 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:17:40 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:17:40 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=25.242938995361328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:17:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:17:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:17:40 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:17:40 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:17:40 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:17:40 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:17:40 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:17:40 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:17:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:17:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:17:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:46 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:17:46 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:17:46 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:17:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:17:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:17:46 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:17:46 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:17:47 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updating instance_info_cache with network_info: [{"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:17:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:17:47 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:17:48 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:17:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:17:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:17:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:17:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:17:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:17:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:17:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:17:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:17:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:18:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:18:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:18:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:18:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:18:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:18:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:18:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:18:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:18:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:18:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:18:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:18:25 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:18:25 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:18:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:18:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:18:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:18:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:18:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:18:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:18:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:18:36 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:18:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:18:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:18:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:18:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:18:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:18:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:18:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:18:40 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:18:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:18:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:18:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:18:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:18:41 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:18:41 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:18:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:18:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:18:42 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:18:42 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:18:42 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:18:42 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8980MB free_disk=25.214550018310547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:18:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:18:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:18:42 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:18:42 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:18:42 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:18:42 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:18:42 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:18:42 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:18:42 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:18:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:18:48 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:18:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:18:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:18:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:18:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:18:48 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:18:48 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:18:49 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updating instance_info_cache with network_info: [{"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:18:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:18:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:18:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:18:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:18:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:18:51 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:18:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:18:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:19:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:19:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:19:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:19:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:19:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:19:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:19:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:19:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:19:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:19:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:19:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:19:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-46d7d574-ea90-45c3-9d6e-48d0a57baf86 req-7e145e3d-1982-400a-9d3c-3f894c109e62 service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Received event network-changed-56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:19:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-46d7d574-ea90-45c3-9d6e-48d0a57baf86 req-7e145e3d-1982-400a-9d3c-3f894c109e62 service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Refreshing instance network info cache due to event network-changed-56007ef9-c855-43e3-86a5-327844116fe1. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:19:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-46d7d574-ea90-45c3-9d6e-48d0a57baf86 req-7e145e3d-1982-400a-9d3c-3f894c109e62 service nova] Acquiring lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:19:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-46d7d574-ea90-45c3-9d6e-48d0a57baf86 req-7e145e3d-1982-400a-9d3c-3f894c109e62 service nova] Acquired lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:19:18 user nova-compute[80928]: DEBUG nova.network.neutron [req-46d7d574-ea90-45c3-9d6e-48d0a57baf86 req-7e145e3d-1982-400a-9d3c-3f894c109e62 service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Refreshing network info cache for port 56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:19:18 user nova-compute[80928]: DEBUG nova.network.neutron [req-46d7d574-ea90-45c3-9d6e-48d0a57baf86 req-7e145e3d-1982-400a-9d3c-3f894c109e62 service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updated VIF entry in instance network info cache for port 56007ef9-c855-43e3-86a5-327844116fe1. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:19:18 user nova-compute[80928]: DEBUG nova.network.neutron [req-46d7d574-ea90-45c3-9d6e-48d0a57baf86 req-7e145e3d-1982-400a-9d3c-3f894c109e62 service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updating instance_info_cache with network_info: [{"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:19:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-46d7d574-ea90-45c3-9d6e-48d0a57baf86 req-7e145e3d-1982-400a-9d3c-3f894c109e62 service nova] Releasing lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG nova.objects.instance [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lazy-loading 'flavor' on Instance uuid 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:19:19 user nova-compute[80928]: INFO nova.compute.manager [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Attaching volume 9d5d2584-8736-4915-9f90-cf2a64303cbc to /dev/vdb
Nov 16 06:19:19 user nova-compute[80928]: DEBUG os_brick.utils [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf9964e-e823-4525-970d-403022a6acc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c59961-9f08-4a95-8266-e8dba2d1748d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dbb89f-1281-4a11-bff8-4676904499fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[22841aa6-58e9-4724-8a69-b2058eda06af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:19:19 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:19:19 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3564725-8a7a-4fbf-bb28-e57093b6a8d0]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG os_brick.utils [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updating existing volume attachment record: 4be196a4-1ddd-4c44-808e-aedd77b07215 {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:19:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRfewUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:19:24 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:19:24 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:19:24 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4287ebf1-f8be-4072-a164-88dcdf58b4fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:19:24 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9662b1-990b-4fdd-959f-84d66b141348]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc] added
Nov 16 06:19:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b34ebf-554a-430d-9959-7a140047f1a6]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[52df2af9-dfe5-4b78-ab1f-956d287a4b3b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGRfewUs {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGRfewUs" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ff7396-8e6d-42f2-b2a9-4e00168d2a26]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nGRfewUs'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c428e421-39b1-464c-b02d-3d0f696f6b7f]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcf22df-b77c-497b-87b7-5f30fdb46609]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:19:24 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:19:24 user nova-compute[80928]:  {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:19:24 user nova-compute[80928]: WARNING os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 06:19:24 user nova-compute[80928]: 
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d70cf1-a703-4677-9f94-90eda9c5256c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc, portal: 172.16.0.220,3260]
Nov 16 06:19:24 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc, portal: 172.16.0.220,3260] successful.
Nov 16 06:19:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13420d9-852a-409d-919b-a511c8bb190c]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[13977383-3ebc-4703-b1c5-be563cc0be5f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)
Nov 16 06:19:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)
Nov 16 06:19:24 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a59365-5dd1-4bbb-8be3-1c7970b02957]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:19:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:25 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:19:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRfewUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:19:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:19:25 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26565666632353038', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:19:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565666632353038', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:19:25 user nova-compute[80928]: DEBUG nova.objects.instance [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lazy-loading 'flavor' on Instance uuid 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:19:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 06:19:25 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:19:25 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:19:25 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:19:25 user nova-compute[80928]:   <serial>9d5d2584-8736-4915-9f90-cf2a64303cbc</serial>
Nov 16 06:19:25 user nova-compute[80928]: </disk>
Nov 16 06:19:25 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 06:19:25 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:19:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:19:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:19:25 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] No VIF found with MAC fa:16:3e:1f:bd:cd, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:19:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-b3ed196b-7e8d-4bac-9f45-86c3a66b8d3c tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.714s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:19:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:27 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:19:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:19:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:19:28 user nova-compute[80928]: DEBUG nova.objects.instance [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lazy-loading 'flavor' on Instance uuid 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:19:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:19:29 user nova-compute[80928]: INFO nova.compute.manager [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Attaching volume 22ed8099-3b82-47f5-8cfa-8279cb2e7e8c to /dev/vdc
Nov 16 06:19:29 user nova-compute[80928]: DEBUG os_brick.utils [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e54479-fdff-4c7c-a503-ff2736fd151a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b29e18b-7243-4ccf-b396-ebe7b08f0a0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb3c2b1-d93f-443f-8033-f92f0bf7ca62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[33148432-405d-447c-aef1-e2acf3df82f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:19:29 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:19:29 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[072968ba-0353-4633-8ca3-a757411efdd8]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG os_brick.utils [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updating existing volume attachment record: 8d31c4bf-2354-4b19-a4a7-b5bac5201dcb {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:19:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLljVwhx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:19:34 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:19:34 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:19:34 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3663594e-432c-40f9-a407-5a4fc123839a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:19:34 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1729a89-4e3e-4aa0-a8c9-cf96e038f63f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c] added
Nov 16 06:19:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b6de3f-9e23-49cd-977c-825d39752618]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[628d8817-9972-4dd2-968c-3c60ed40a95f]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLljVwhx {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLljVwhx" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b14807-7314-4e26-9b25-2ec59c7f4cfe]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZLljVwhx'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[799bca9d-cf4e-4d05-bdef-3b4d0a12f881]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[205e25ee-efa4-4f72-9481-3eca16d7db5d]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)
Nov 16 06:19:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)
Nov 16 06:19:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c6853f-1f04-47a9-822a-a295357bcd6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c, portal: 172.16.0.220,3260]
Nov 16 06:19:34 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c, portal: 172.16.0.220,3260] successful.
Nov 16 06:19:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79f72b5-ab94-417f-9137-59bc360e12d7]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dcaca5-3506-4e6e-a370-3a72849e4e7e]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)
Nov 16 06:19:34 user nova-compute[80928]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c (non-flash)
Nov 16 06:19:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)
Nov 16 06:19:34 user nova-compute[80928]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c (non-flash)
Nov 16 06:19:34 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[00402793-a276-4068-87c7-7545078c5d3b]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:19:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:19:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLljVwhx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:19:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:19:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23832633135343965', 'path': '/dev/sdc'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:19:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832633135343965', 'path': '/dev/sdc'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:19:35 user nova-compute[80928]: DEBUG nova.objects.instance [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lazy-loading 'flavor' on Instance uuid 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:19:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 06:19:35 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:19:35 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 06:19:35 user nova-compute[80928]:   <target dev="vdc" bus="virtio"/>
Nov 16 06:19:35 user nova-compute[80928]:   <serial>22ed8099-3b82-47f5-8cfa-8279cb2e7e8c</serial>
Nov 16 06:19:35 user nova-compute[80928]: </disk>
Nov 16 06:19:35 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 06:19:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:19:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:19:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] No BDM found with device name vdc, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:19:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] No VIF found with MAC fa:16:3e:1f:bd:cd, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:19:36 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-d61bb111-ecac-4015-b1ab-f44f57114691 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.076s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:19:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:36 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:19:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:19:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:19:37 user nova-compute[80928]: INFO nova.compute.manager [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Detaching volume 22ed8099-3b82-47f5-8cfa-8279cb2e7e8c
Nov 16 06:19:37 user nova-compute[80928]: INFO nova.virt.block_device [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Attempting to driver detach volume 22ed8099-3b82-47f5-8cfa-8279cb2e7e8c from mountpoint /dev/vdc
Nov 16 06:19:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Attempting to detach device vdc from instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 06:19:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:19:37 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:19:37 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 06:19:37 user nova-compute[80928]:   <target dev="vdc" bus="virtio"/>
Nov 16 06:19:37 user nova-compute[80928]:   <serial>22ed8099-3b82-47f5-8cfa-8279cb2e7e8c</serial>
Nov 16 06:19:37 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 06:19:37 user nova-compute[80928]: </disk>
Nov 16 06:19:37 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:19:37 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Successfully detached device vdc from instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d from the persistent domain config.
Nov 16 06:19:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 06:19:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:19:37 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:19:37 user nova-compute[80928]:   <source dev="/dev/sdc"/>
Nov 16 06:19:37 user nova-compute[80928]:   <target dev="vdc" bus="virtio"/>
Nov 16 06:19:37 user nova-compute[80928]:   <serial>22ed8099-3b82-47f5-8cfa-8279cb2e7e8c</serial>
Nov 16 06:19:37 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 06:19:37 user nova-compute[80928]: </disk>
Nov 16 06:19:37 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:19:37 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 06:19:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:19:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:19:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:19:43 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:19:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:19:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:19:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:19:43 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:19:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=80928) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 06:19:44 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:19:44 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:19:44 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=25.21306610107422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:19:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:19:48 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:19:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:19:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:19:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:19:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:19:48 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:19:48 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:19:49 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updating instance_info_cache with network_info: [{"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:19:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:19:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:19:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:19:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:19:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:19:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:19:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:19:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:19:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:19:52 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:19:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:57 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d is timed out.
Nov 16 06:19:57 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Successfully detached device vdc from instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d from the live domain config.
Nov 16 06:19:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLljVwhx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:19:57 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[198909d3-b8ab-4486-a025-0b1de0cd0a4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:19:57 user nova-compute[80928]: No targets found.
Nov 16 06:19:57 user nova-compute[80928]: iSNS:
Nov 16 06:19:57 user nova-compute[80928]: No targets found.
Nov 16 06:19:57 user nova-compute[80928]: STATIC:
Nov 16 06:19:57 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c
Nov 16 06:19:57 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:19:57 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:19:57 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc
Nov 16 06:19:57 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:19:57 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:19:57 user nova-compute[80928]: FIRMWARE:
Nov 16 06:19:57 user nova-compute[80928]: No targets found.
Nov 16 06:19:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:19:57 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:19:57 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bbde5d-65d3-485c-ba1f-2cd18876983c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ceedb7-d90f-4e32-b3d6-364b4901af53]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)
Nov 16 06:19:57 user nova-compute[80928]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c (non-flash)
Nov 16 06:19:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)
Nov 16 06:19:57 user nova-compute[80928]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c (non-flash)
Nov 16 06:19:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8678207880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c'): ({'sdc'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Removing single pathed devices sdc {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e520d7e2-55b6-4fe9-9c3d-c43fab253512]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2366d146-8de3-410d-87c6-1e1d1a1273e0]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Flushing IO for device /dev/sdc {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[671afdd7-5085-4b82-ae83-56af4287b1dd]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f652f9-4dd0-4ae4-af5b-4579542d5360]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] SCSI volumes sdc have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bec140-be7c-4b0b-b5d2-91893ea6c191]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e788aca8-3e53-483f-bd8e-fb6acd2aa1f2]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c, portal: 172.16.0.220,3260]
Nov 16 06:19:57 user nova-compute[80928]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c, portal: 172.16.0.220,3260] successful.
Nov 16 06:19:57 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ed8099-3b82-47f5-8cfa-8279cb2e7e8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf26e0a3-b967-4edd-a549-5dbbb87d8781]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] <== disconnect_volume: return (303ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:19:57 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:19:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lazy-loading 'flavor' on Instance uuid 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:19:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-84ce5a28-c988-439f-9554-10c6b70bb3aa tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.846s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:19:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:19:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:19:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:19:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:19:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:19:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:20:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:20:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:20:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:20:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:20:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:20:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:20:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:20:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:20:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:20:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:20:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:20:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:20:27 user nova-compute[80928]: INFO nova.compute.manager [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Detaching volume 9d5d2584-8736-4915-9f90-cf2a64303cbc
Nov 16 06:20:27 user nova-compute[80928]: INFO nova.virt.block_device [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Attempting to driver detach volume 9d5d2584-8736-4915-9f90-cf2a64303cbc from mountpoint /dev/vdb
Nov 16 06:20:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Attempting to detach device vdb from instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 06:20:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:20:27 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:20:27 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:20:27 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:20:27 user nova-compute[80928]:   <serial>9d5d2584-8736-4915-9f90-cf2a64303cbc</serial>
Nov 16 06:20:27 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:20:27 user nova-compute[80928]: </disk>
Nov 16 06:20:27 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:20:27 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Successfully detached device vdb from instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d from the persistent domain config.
Nov 16 06:20:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 06:20:27 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:20:27 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:20:27 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:20:27 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:20:27 user nova-compute[80928]:   <serial>9d5d2584-8736-4915-9f90-cf2a64303cbc</serial>
Nov 16 06:20:27 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:20:27 user nova-compute[80928]: </disk>
Nov 16 06:20:27 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:20:27 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:20:27 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:20:28 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 06:20:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:20:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:20:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:20:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:20:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:20:29 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:20:34 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:20:38 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:20:39 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:20:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:20:43 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:20:43 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:20:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:20:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:20:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:20:43 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:20:43 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:20:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:20:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:20:44 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:20:44 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:20:44 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:20:44 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=25.21242904663086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:20:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:20:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:20:44 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:20:45 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:20:45 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:20:45 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:20:45 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing inventories for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 06:20:45 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating ProviderTree inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 06:20:45 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 06:20:45 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing aggregate associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, aggregates: None {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 06:20:45 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing trait associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 06:20:45 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:20:45 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:20:45 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:20:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.664s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:20:48 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d is timed out.
Nov 16 06:20:48 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Successfully detached device vdb from instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d from the live domain config.
Nov 16 06:20:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGRfewUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:20:48 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a45b30-bc7d-438e-ab08-598c2a1a3972]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:20:48 user nova-compute[80928]: No targets found.
Nov 16 06:20:48 user nova-compute[80928]: iSNS:
Nov 16 06:20:48 user nova-compute[80928]: No targets found.
Nov 16 06:20:48 user nova-compute[80928]: STATIC:
Nov 16 06:20:48 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc
Nov 16 06:20:48 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:20:48 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:20:48 user nova-compute[80928]: FIRMWARE:
Nov 16 06:20:48 user nova-compute[80928]: No targets found.
Nov 16 06:20:48 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:20:48 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:20:48 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[481f2e21-ad51-4605-b466-38b6459f2fc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2d0ea7-c48e-47fd-bc73-cdc008c48af9]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)
Nov 16 06:20:48 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc (non-flash)
Nov 16 06:20:48 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f867858b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e91c15-ec3f-4185-872e-05f0172d1a39]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a20985-45fd-4e98-b297-397d69f508db]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e58e2ef-2a1c-43d1-ba41-b4cfd0b2c431]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[da21cbbd-a7d5-47e3-883b-c2b05c0230e0]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e25b483-d000-4cec-b7f5-8cd86fcd7e05]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[60219db9-06a3-4115-a501-e044f190cd23]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc, portal: 172.16.0.220,3260]
Nov 16 06:20:48 user nova-compute[80928]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc, portal: 172.16.0.220,3260] successful.
Nov 16 06:20:48 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d5d2584-8736-4915-9f90-cf2a64303cbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c517f08-5619-4170-a5d3-b463bb438c9b]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] <== disconnect_volume: return (291ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:20:48 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:20:49 user nova-compute[80928]: DEBUG nova.objects.instance [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lazy-loading 'flavor' on Instance uuid 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:20:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-1e50100e-7ca8-4142-9c93-9123aed81c66 tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.744s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:20:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:20:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:20:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:20:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:20:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:20:49 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:20:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:20:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:20:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:20:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:20:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:20:50 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:20:50 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:20:50 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updating instance_info_cache with network_info: [{"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:20:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:20:50 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:20:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:20:53 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:20:53 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances with incomplete migration  {{(pid=80928) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 06:20:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:20:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:20:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:20:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:20:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:20:54 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:20:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:20:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:20:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:20:59 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:21:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:21:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:21:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:21:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:21:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:12 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:21:12 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 06:21:12 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] There are 0 instances to clean {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 06:21:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:21:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:21:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:21:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:21:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:21:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:21:17 user nova-compute[80928]: INFO nova.compute.manager [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Terminating instance
Nov 16 06:21:17 user nova-compute[80928]: DEBUG nova.compute.manager [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:21:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-9baedc18-1d71-478a-b69d-fa79bb7c413a req-bf55e28f-045f-4d70-91c8-a52262f8c74e service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Received event network-vif-unplugged-56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9baedc18-1d71-478a-b69d-fa79bb7c413a req-bf55e28f-045f-4d70-91c8-a52262f8c74e service nova] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9baedc18-1d71-478a-b69d-fa79bb7c413a req-bf55e28f-045f-4d70-91c8-a52262f8c74e service nova] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-9baedc18-1d71-478a-b69d-fa79bb7c413a req-bf55e28f-045f-4d70-91c8-a52262f8c74e service nova] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-9baedc18-1d71-478a-b69d-fa79bb7c413a req-bf55e28f-045f-4d70-91c8-a52262f8c74e service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] No waiting events found dispatching network-vif-unplugged-56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG nova.compute.manager [req-9baedc18-1d71-478a-b69d-fa79bb7c413a req-bf55e28f-045f-4d70-91c8-a52262f8c74e service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Received event network-vif-unplugged-56007ef9-c855-43e3-86a5-327844116fe1 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Instance destroyed successfully.
Nov 16 06:21:18 user nova-compute[80928]: DEBUG nova.objects.instance [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lazy-loading 'resources' on Instance uuid 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-546244839',display_name='tempest-TestServerVolumeAttachmentScenario-server-546244839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-546244839',id=52,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiq9crj0rlLo1CY4r/fvWP4Ofm2LQRcqXJMbKoJcUmOYcXd9fR6+YHeU2I1C4+0sNI8be4iYGhiENXFVH0o0c7MfPX2wxwTUIgOC5xOHmJsXUBpq6OgeQ0yiSfKmTUgyQ==',key_name='tempest-keypair-1161425848',keypairs=<?>,launch_index=0,launched_at=2023-11-16T06:17:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2728893eb13a43b08036aeb4e38e6a3a',ramdisk_id='',reservation_id='r-z6fj78v1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-50594187',owner_user_name='tempest-TestServerVolumeAttachmentScenario-50594187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T06:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='592f4db4b7164cbfacefe4f0c03dbeec',uuid=4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Converting VIF {"id": "56007ef9-c855-43e3-86a5-327844116fe1", "address": "fa:16:3e:1f:bd:cd", "network": {"id": "033dcef7-376a-4a0e-822c-d9fe63f70bc1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478160355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2728893eb13a43b08036aeb4e38e6a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56007ef9-c8", "ovs_interfaceid": "56007ef9-c855-43e3-86a5-327844116fe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:bd:cd,bridge_name='br-int',has_traffic_filtering=True,id=56007ef9-c855-43e3-86a5-327844116fe1,network=Network(033dcef7-376a-4a0e-822c-d9fe63f70bc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56007ef9-c8') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG os_vif [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:bd:cd,bridge_name='br-int',has_traffic_filtering=True,id=56007ef9-c855-43e3-86a5-327844116fe1,network=Network(033dcef7-376a-4a0e-822c-d9fe63f70bc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56007ef9-c8') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56007ef9-c8, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=385d8a01-fc15-4798-9a56-37d1c0309c9d) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:21:18 user nova-compute[80928]: INFO os_vif [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:bd:cd,bridge_name='br-int',has_traffic_filtering=True,id=56007ef9-c855-43e3-86a5-327844116fe1,network=Network(033dcef7-376a-4a0e-822c-d9fe63f70bc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56007ef9-c8')
Nov 16 06:21:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Deleting instance files /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d_del
Nov 16 06:21:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Deletion of /opt/stack/data/nova/instances/4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d_del complete
Nov 16 06:21:18 user nova-compute[80928]: INFO nova.compute.manager [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 06:21:18 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:21:18 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:21:19 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:21:19 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Took 1.03 seconds to deallocate network for instance.
Nov 16 06:21:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:21:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:21:19 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:21:20 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:21:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:21:20 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Deleted allocations for instance 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d
Nov 16 06:21:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-7c444d94-ef7e-49ea-a7f0-c10e6d927caf tempest-TestServerVolumeAttachmentScenario-50594187 tempest-TestServerVolumeAttachmentScenario-50594187-project-member] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.246s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:21:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-b9bab757-1261-42ab-a407-d9893c595529 req-a63f1f7d-e8fe-4746-aa92-2b94bff6a78f service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Received event network-vif-plugged-56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:21:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b9bab757-1261-42ab-a407-d9893c595529 req-a63f1f7d-e8fe-4746-aa92-2b94bff6a78f service nova] Acquiring lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:21:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b9bab757-1261-42ab-a407-d9893c595529 req-a63f1f7d-e8fe-4746-aa92-2b94bff6a78f service nova] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:21:20 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-b9bab757-1261-42ab-a407-d9893c595529 req-a63f1f7d-e8fe-4746-aa92-2b94bff6a78f service nova] Lock "4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:21:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-b9bab757-1261-42ab-a407-d9893c595529 req-a63f1f7d-e8fe-4746-aa92-2b94bff6a78f service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] No waiting events found dispatching network-vif-plugged-56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:21:20 user nova-compute[80928]: WARNING nova.compute.manager [req-b9bab757-1261-42ab-a407-d9893c595529 req-a63f1f7d-e8fe-4746-aa92-2b94bff6a78f service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Received unexpected event network-vif-plugged-56007ef9-c855-43e3-86a5-327844116fe1 for instance with vm_state deleted and task_state None.
Nov 16 06:21:20 user nova-compute[80928]: DEBUG nova.compute.manager [req-b9bab757-1261-42ab-a407-d9893c595529 req-a63f1f7d-e8fe-4746-aa92-2b94bff6a78f service nova] [instance: 4929aaa3-937d-4ec7-9e9b-7b70fc47bd1d] Received event network-vif-deleted-56007ef9-c855-43e3-86a5-327844116fe1 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:21:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:27 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:21:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:28 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:21:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:21:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:21:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:21:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:21:43 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:21:43 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:21:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:21:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:21:43 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:21:43 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:21:44 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:21:44 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:21:44 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=9144MB free_disk=25.231815338134766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:21:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:21:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:21:44 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:21:44 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:21:44 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:21:44 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:21:44 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:21:44 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:21:46 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:21:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:21:48 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:21:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:21:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:21:48 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 06:21:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:21:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:21:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:21:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:21:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:22:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:08 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:22:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:22:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:22:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:22:13 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:17 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:18 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:23 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:28 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:29 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:22:30 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:22:33 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:38 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:22:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:22:43 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:22:45 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:22:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:22:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:22:45 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:22:45 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:22:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:46 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:22:46 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:22:46 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8866MB free_disk=25.22840118408203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:22:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:22:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:22:46 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:22:46 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:22:46 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:22:46 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:22:46 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:22:46 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:22:47 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:22:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:48 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:22:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:22:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:22:49 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 06:22:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:53 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:53 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:22:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:22:57 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:22:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:22:58 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:23:01 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:23:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Starting instance... {{(pid=80928) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=80928) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 06:23:02 user nova-compute[80928]: INFO nova.compute.claims [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Claim successful on node user
Nov 16 06:23:02 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Start building networks asynchronously for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Allocating IP information in the background. {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] allocate_for_instance() {{(pid=80928) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 06:23:02 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 06:23:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Start building block device mappings for instance. {{(pid=80928) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG nova.policy [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '971ec18e5f0447d3933d3bed657cf72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a03daf1cbb48a3bd8abc10d1c22443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80928) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Start spawning the instance on the hypervisor. {{(pid=80928) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Creating instance directory {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 06:23:02 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Creating image(s)
Nov 16 06:23:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "/opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "/opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.229s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "068709ea92c399b35918a38a3e63ff37e2654176" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:23:02 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.221s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk 1073741824 {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176,backing_fmt=raw /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk 1073741824" returned: 0 in 0.076s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "068709ea92c399b35918a38a3e63ff37e2654176" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068709ea92c399b35918a38a3e63ff37e2654176 --force-share --output=json" returned: 0 in 0.191s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk. size=1073741824 {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG nova.virt.disk.api [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Cannot resize image /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk to a smaller size. {{(pid=80928) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Created local disks {{(pid=80928) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Ensure instance console log exists: /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/console.log {{(pid=80928) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Successfully created port: 725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 06:23:03 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Successfully updated port: 725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquired lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Building network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-998e0fea-de94-42ae-ad0a-d8bc5e1e73c6 req-70cf8331-cf16-40f4-aea8-c8f44e788960 service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Received event network-changed-725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.compute.manager [req-998e0fea-de94-42ae-ad0a-d8bc5e1e73c6 req-70cf8331-cf16-40f4-aea8-c8f44e788960 service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Refreshing instance network info cache due to event network-changed-725a5921-2540-4281-af5c-05d1b9124964. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-998e0fea-de94-42ae-ad0a-d8bc5e1e73c6 req-70cf8331-cf16-40f4-aea8-c8f44e788960 service nova] Acquiring lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Instance cache missing network info. {{(pid=80928) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.network.neutron [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating instance_info_cache with network_info: [{"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Releasing lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Instance network_info: |[{"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=80928) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-998e0fea-de94-42ae-ad0a-d8bc5e1e73c6 req-70cf8331-cf16-40f4-aea8-c8f44e788960 service nova] Acquired lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.network.neutron [req-998e0fea-de94-42ae-ad0a-d8bc5e1e73c6 req-70cf8331-cf16-40f4-aea8-c8f44e788960 service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Refreshing network info cache for port 725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Start _get_guest_xml network_info=[{"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c747fce3-6158-4d78-9cb4-34afacae8f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 06:23:04 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:23:04 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] CPU controller missing on host. {{(pid=80928) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.host [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] CPU controller found on host. {{(pid=80928) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=80928) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T05:25:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T05:25:18Z,direct_url=<?>,disk_format='qcow2',id=c747fce3-6158-4d78-9cb4-34afacae8f7a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='28be64da55224dbd92019438281cfb48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T05:25:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Flavor limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Image limits 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Flavor pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Image pref 0:0:0 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=80928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Got 1 possible topologies {{(pid=80928) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.hardware [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=80928) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:23:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1356063432',display_name='tempest-SnapshotDataIntegrityTests-server-1356063432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1356063432',id=53,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr0Iz0f0IYXeNPFuV0JDKd+4cNS1kCubJtlwPB0L9Wxe7+OlolsnvLC07NwV8tRJfBReK0uVUnMN9V/WOy9Avv8DIpbWgfM20czReidGjhWYIZoduj9Zdb4B1shBtSAjg==',key_name='tempest-keypair-736099567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95a03daf1cbb48a3bd8abc10d1c22443',ramdisk_id='',reservation_id='r-1ag3u252',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1419883759',owner_user_name='tempest-SnapshotDataIntegrityTests-1419883759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='971ec18e5f0447d3933d3bed657cf72c',uuid=cd9be15f-178f-4cec-a49d-ae9bf5c38780,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=80928) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Converting VIF {"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:46:96,bridge_name='br-int',has_traffic_filtering=True,id=725a5921-2540-4281-af5c-05d1b9124964,network=Network(941378c4-8aef-4417-9aff-3d37cc95e095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725a5921-25') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.objects.instance [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'pci_devices' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] End _get_guest_xml xml=<domain type="kvm">
Nov 16 06:23:04 user nova-compute[80928]:   <uuid>cd9be15f-178f-4cec-a49d-ae9bf5c38780</uuid>
Nov 16 06:23:04 user nova-compute[80928]:   <name>instance-00000035</name>
Nov 16 06:23:04 user nova-compute[80928]:   <memory>524288</memory>
Nov 16 06:23:04 user nova-compute[80928]:   <vcpu>1</vcpu>
Nov 16 06:23:04 user nova-compute[80928]:   <metadata>
Nov 16 06:23:04 user nova-compute[80928]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 06:23:04 user nova-compute[80928]:       <nova:package version="0.0.0"/>
Nov 16 06:23:04 user nova-compute[80928]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1356063432</nova:name>
Nov 16 06:23:04 user nova-compute[80928]:       <nova:creationTime>2023-11-16 06:23:04</nova:creationTime>
Nov 16 06:23:04 user nova-compute[80928]:       <nova:flavor name="m1.tiny">
Nov 16 06:23:04 user nova-compute[80928]:         <nova:memory>512</nova:memory>
Nov 16 06:23:04 user nova-compute[80928]:         <nova:disk>1</nova:disk>
Nov 16 06:23:04 user nova-compute[80928]:         <nova:swap>0</nova:swap>
Nov 16 06:23:04 user nova-compute[80928]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 06:23:04 user nova-compute[80928]:         <nova:vcpus>1</nova:vcpus>
Nov 16 06:23:04 user nova-compute[80928]:       </nova:flavor>
Nov 16 06:23:04 user nova-compute[80928]:       <nova:owner>
Nov 16 06:23:04 user nova-compute[80928]:         <nova:user uuid="971ec18e5f0447d3933d3bed657cf72c">tempest-SnapshotDataIntegrityTests-1419883759-project-member</nova:user>
Nov 16 06:23:04 user nova-compute[80928]:         <nova:project uuid="95a03daf1cbb48a3bd8abc10d1c22443">tempest-SnapshotDataIntegrityTests-1419883759</nova:project>
Nov 16 06:23:04 user nova-compute[80928]:       </nova:owner>
Nov 16 06:23:04 user nova-compute[80928]:       <nova:root type="image" uuid="c747fce3-6158-4d78-9cb4-34afacae8f7a"/>
Nov 16 06:23:04 user nova-compute[80928]:       <nova:ports>
Nov 16 06:23:04 user nova-compute[80928]:         <nova:port uuid="725a5921-2540-4281-af5c-05d1b9124964">
Nov 16 06:23:04 user nova-compute[80928]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 06:23:04 user nova-compute[80928]:         </nova:port>
Nov 16 06:23:04 user nova-compute[80928]:       </nova:ports>
Nov 16 06:23:04 user nova-compute[80928]:     </nova:instance>
Nov 16 06:23:04 user nova-compute[80928]:   </metadata>
Nov 16 06:23:04 user nova-compute[80928]:   <sysinfo type="smbios">
Nov 16 06:23:04 user nova-compute[80928]:     <system>
Nov 16 06:23:04 user nova-compute[80928]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 06:23:04 user nova-compute[80928]:       <entry name="product">OpenStack Nova</entry>
Nov 16 06:23:04 user nova-compute[80928]:       <entry name="version">0.0.0</entry>
Nov 16 06:23:04 user nova-compute[80928]:       <entry name="serial">cd9be15f-178f-4cec-a49d-ae9bf5c38780</entry>
Nov 16 06:23:04 user nova-compute[80928]:       <entry name="uuid">cd9be15f-178f-4cec-a49d-ae9bf5c38780</entry>
Nov 16 06:23:04 user nova-compute[80928]:       <entry name="family">Virtual Machine</entry>
Nov 16 06:23:04 user nova-compute[80928]:     </system>
Nov 16 06:23:04 user nova-compute[80928]:   </sysinfo>
Nov 16 06:23:04 user nova-compute[80928]:   <os>
Nov 16 06:23:04 user nova-compute[80928]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 06:23:04 user nova-compute[80928]:     <boot dev="hd"/>
Nov 16 06:23:04 user nova-compute[80928]:     <smbios mode="sysinfo"/>
Nov 16 06:23:04 user nova-compute[80928]:   </os>
Nov 16 06:23:04 user nova-compute[80928]:   <features>
Nov 16 06:23:04 user nova-compute[80928]:     <acpi/>
Nov 16 06:23:04 user nova-compute[80928]:     <apic/>
Nov 16 06:23:04 user nova-compute[80928]:     <vmcoreinfo/>
Nov 16 06:23:04 user nova-compute[80928]:   </features>
Nov 16 06:23:04 user nova-compute[80928]:   <clock offset="utc">
Nov 16 06:23:04 user nova-compute[80928]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 06:23:04 user nova-compute[80928]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 06:23:04 user nova-compute[80928]:     <timer name="hpet" present="no"/>
Nov 16 06:23:04 user nova-compute[80928]:   </clock>
Nov 16 06:23:04 user nova-compute[80928]:   <cpu mode="custom" match="exact">
Nov 16 06:23:04 user nova-compute[80928]:     <model>Nehalem</model>
Nov 16 06:23:04 user nova-compute[80928]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 06:23:04 user nova-compute[80928]:   </cpu>
Nov 16 06:23:04 user nova-compute[80928]:   <devices>
Nov 16 06:23:04 user nova-compute[80928]:     <disk type="file" device="disk">
Nov 16 06:23:04 user nova-compute[80928]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 06:23:04 user nova-compute[80928]:       <source file="/opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk"/>
Nov 16 06:23:04 user nova-compute[80928]:       <target dev="vda" bus="virtio"/>
Nov 16 06:23:04 user nova-compute[80928]:     </disk>
Nov 16 06:23:04 user nova-compute[80928]:     <interface type="ethernet">
Nov 16 06:23:04 user nova-compute[80928]:       <mac address="fa:16:3e:40:46:96"/>
Nov 16 06:23:04 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:23:04 user nova-compute[80928]:       <mtu size="1442"/>
Nov 16 06:23:04 user nova-compute[80928]:       <target dev="tap725a5921-25"/>
Nov 16 06:23:04 user nova-compute[80928]:     </interface>
Nov 16 06:23:04 user nova-compute[80928]:     <serial type="pty">
Nov 16 06:23:04 user nova-compute[80928]:       <log file="/opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/console.log" append="off"/>
Nov 16 06:23:04 user nova-compute[80928]:     </serial>
Nov 16 06:23:04 user nova-compute[80928]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 06:23:04 user nova-compute[80928]:     <video>
Nov 16 06:23:04 user nova-compute[80928]:       <model type="virtio"/>
Nov 16 06:23:04 user nova-compute[80928]:     </video>
Nov 16 06:23:04 user nova-compute[80928]:     <rng model="virtio">
Nov 16 06:23:04 user nova-compute[80928]:       <backend model="random">/dev/urandom</backend>
Nov 16 06:23:04 user nova-compute[80928]:     </rng>
Nov 16 06:23:04 user nova-compute[80928]:     <controller type="usb" index="0" model="none"/>
Nov 16 06:23:04 user nova-compute[80928]:     <memballoon model="virtio">
Nov 16 06:23:04 user nova-compute[80928]:       <stats period="10"/>
Nov 16 06:23:04 user nova-compute[80928]:     </memballoon>
Nov 16 06:23:04 user nova-compute[80928]:   </devices>
Nov 16 06:23:04 user nova-compute[80928]: </domain>
Nov 16 06:23:04 user nova-compute[80928]:  {{(pid=80928) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:23:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1356063432',display_name='tempest-SnapshotDataIntegrityTests-server-1356063432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1356063432',id=53,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr0Iz0f0IYXeNPFuV0JDKd+4cNS1kCubJtlwPB0L9Wxe7+OlolsnvLC07NwV8tRJfBReK0uVUnMN9V/WOy9Avv8DIpbWgfM20czReidGjhWYIZoduj9Zdb4B1shBtSAjg==',key_name='tempest-keypair-736099567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95a03daf1cbb48a3bd8abc10d1c22443',ramdisk_id='',reservation_id='r-1ag3u252',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1419883759',owner_user_name='tempest-SnapshotDataIntegrityTests-1419883759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T06:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='971ec18e5f0447d3933d3bed657cf72c',uuid=cd9be15f-178f-4cec-a49d-ae9bf5c38780,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Converting VIF {"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:46:96,bridge_name='br-int',has_traffic_filtering=True,id=725a5921-2540-4281-af5c-05d1b9124964,network=Network(941378c4-8aef-4417-9aff-3d37cc95e095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725a5921-25') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG os_vif [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:46:96,bridge_name='br-int',has_traffic_filtering=True,id=725a5921-2540-4281-af5c-05d1b9124964,network=Network(941378c4-8aef-4417-9aff-3d37cc95e095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725a5921-25') {{(pid=80928) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54561e64-fbe7-545d-89f1-cef2674717af', '_type': 'linux-noop'}}, row=False) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap725a5921-25, may_exist=True, interface_attrs={}) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap725a5921-25, col_values=(('qos', UUID('3355439b-026c-4b9d-9504-b15727337de1')),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap725a5921-25, col_values=(('external_ids', {'iface-id': '725a5921-2540-4281-af5c-05d1b9124964', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:46:96', 'vm-uuid': 'cd9be15f-178f-4cec-a49d-ae9bf5c38780'}),), if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:23:04 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:05 user nova-compute[80928]: INFO os_vif [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:46:96,bridge_name='br-int',has_traffic_filtering=True,id=725a5921-2540-4281-af5c-05d1b9124964,network=Network(941378c4-8aef-4417-9aff-3d37cc95e095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725a5921-25')
Nov 16 06:23:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:23:05 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No VIF found with MAC fa:16:3e:40:46:96, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:23:05 user nova-compute[80928]: DEBUG nova.network.neutron [req-998e0fea-de94-42ae-ad0a-d8bc5e1e73c6 req-70cf8331-cf16-40f4-aea8-c8f44e788960 service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updated VIF entry in instance network info cache for port 725a5921-2540-4281-af5c-05d1b9124964. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:23:05 user nova-compute[80928]: DEBUG nova.network.neutron [req-998e0fea-de94-42ae-ad0a-d8bc5e1e73c6 req-70cf8331-cf16-40f4-aea8-c8f44e788960 service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating instance_info_cache with network_info: [{"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:23:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-998e0fea-de94-42ae-ad0a-d8bc5e1e73c6 req-70cf8331-cf16-40f4-aea8-c8f44e788960 service nova] Releasing lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:23:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-1daf8f04-a5e1-4b37-b339-b9835fc8d145 req-35b7c293-eefc-46e3-b2d1-31675b5b3a8b service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Received event network-vif-plugged-725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:23:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1daf8f04-a5e1-4b37-b339-b9835fc8d145 req-35b7c293-eefc-46e3-b2d1-31675b5b3a8b service nova] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:23:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1daf8f04-a5e1-4b37-b339-b9835fc8d145 req-35b7c293-eefc-46e3-b2d1-31675b5b3a8b service nova] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:23:07 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-1daf8f04-a5e1-4b37-b339-b9835fc8d145 req-35b7c293-eefc-46e3-b2d1-31675b5b3a8b service nova] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:23:07 user nova-compute[80928]: DEBUG nova.compute.manager [req-1daf8f04-a5e1-4b37-b339-b9835fc8d145 req-35b7c293-eefc-46e3-b2d1-31675b5b3a8b service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] No waiting events found dispatching network-vif-plugged-725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:23:07 user nova-compute[80928]: WARNING nova.compute.manager [req-1daf8f04-a5e1-4b37-b339-b9835fc8d145 req-35b7c293-eefc-46e3-b2d1-31675b5b3a8b service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Received unexpected event network-vif-plugged-725a5921-2540-4281-af5c-05d1b9124964 for instance with vm_state building and task_state spawning.
Nov 16 06:23:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:07 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:08 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Instance event wait completed in 0 seconds for  {{(pid=80928) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 06:23:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Guest created on hypervisor {{(pid=80928) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 06:23:08 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Instance spawned successfully.
Nov 16 06:23:08 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 06:23:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Found default for hw_cdrom_bus of ide {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:23:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Found default for hw_disk_bus of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:23:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Found default for hw_input_bus of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:23:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Found default for hw_pointer_model of None {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:23:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Found default for hw_video_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:23:09 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Found default for hw_vif_model of virtio {{(pid=80928) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 06:23:09 user nova-compute[80928]: INFO nova.compute.manager [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 16 06:23:09 user nova-compute[80928]: DEBUG nova.compute.manager [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Checking state {{(pid=80928) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 06:23:09 user nova-compute[80928]: INFO nova.compute.manager [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Took 7.30 seconds to build instance.
Nov 16 06:23:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-e16a128b-958c-4f37-b16b-ff8c6716f7a7 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.431s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:23:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-470a51bf-1828-4fba-88ce-1a35e41017f6 req-94f990f0-1f73-4b28-a1b8-3560abd6240d service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Received event network-vif-plugged-725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:23:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-470a51bf-1828-4fba-88ce-1a35e41017f6 req-94f990f0-1f73-4b28-a1b8-3560abd6240d service nova] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:23:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-470a51bf-1828-4fba-88ce-1a35e41017f6 req-94f990f0-1f73-4b28-a1b8-3560abd6240d service nova] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:23:09 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-470a51bf-1828-4fba-88ce-1a35e41017f6 req-94f990f0-1f73-4b28-a1b8-3560abd6240d service nova] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:23:09 user nova-compute[80928]: DEBUG nova.compute.manager [req-470a51bf-1828-4fba-88ce-1a35e41017f6 req-94f990f0-1f73-4b28-a1b8-3560abd6240d service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] No waiting events found dispatching network-vif-plugged-725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:23:09 user nova-compute[80928]: WARNING nova.compute.manager [req-470a51bf-1828-4fba-88ce-1a35e41017f6 req-94f990f0-1f73-4b28-a1b8-3560abd6240d service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Received unexpected event network-vif-plugged-725a5921-2540-4281-af5c-05d1b9124964 for instance with vm_state active and task_state None.
Nov 16 06:23:09 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:14 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:23:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:24 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:30 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:23:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:31 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:23:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:40 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:23:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:41 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:23:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:47 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:23:47 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:23:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:23:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:23:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:23:47 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:23:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:23:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:23:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:23:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:23:48 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:23:48 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:23:48 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=25.186355590820312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:23:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:23:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:23:48 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:23:48 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:23:48 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:23:48 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:23:48 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:23:48 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:23:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:23:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:23:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:23:51 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:23:51 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:23:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:23:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:23:51 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:23:51 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:23:52 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating instance_info_cache with network_info: [{"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:23:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:23:52 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:23:53 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:23:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:23:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:23:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:23:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:23:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:23:59 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:23:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:24:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:24:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:24:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:24:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:24:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:24:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:24:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:24:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:24:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:24:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:24:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:24:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:24:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:24:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:24:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:24:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:24:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:24:31 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:24:32 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:24:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:24:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:24:40 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:24:42 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:24:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:24:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:24:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:24:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:24:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:24:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:24:47 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:24:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:24:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:24:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:24:47 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:24:47 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:24:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:24:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:24:48 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:24:48 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:24:48 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:24:48 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8992MB free_disk=25.18579864501953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:24:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:24:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:24:48 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:24:48 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:24:48 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:24:48 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:24:48 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:24:48 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:24:48 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:24:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:24:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:24:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:24:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:24:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:24:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:24:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:24:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:24:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-a61d22c0-6971-455f-a47f-ddefc30e197f req-958720ef-353a-47b4-8b0d-dcc63858f70e service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Received event network-changed-725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:24:52 user nova-compute[80928]: DEBUG nova.compute.manager [req-a61d22c0-6971-455f-a47f-ddefc30e197f req-958720ef-353a-47b4-8b0d-dcc63858f70e service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Refreshing instance network info cache due to event network-changed-725a5921-2540-4281-af5c-05d1b9124964. {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 06:24:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a61d22c0-6971-455f-a47f-ddefc30e197f req-958720ef-353a-47b4-8b0d-dcc63858f70e service nova] Acquiring lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:24:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a61d22c0-6971-455f-a47f-ddefc30e197f req-958720ef-353a-47b4-8b0d-dcc63858f70e service nova] Acquired lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:24:52 user nova-compute[80928]: DEBUG nova.network.neutron [req-a61d22c0-6971-455f-a47f-ddefc30e197f req-958720ef-353a-47b4-8b0d-dcc63858f70e service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Refreshing network info cache for port 725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 06:24:52 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:24:52 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:24:52 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:24:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:24:53 user nova-compute[80928]: DEBUG nova.network.neutron [req-a61d22c0-6971-455f-a47f-ddefc30e197f req-958720ef-353a-47b4-8b0d-dcc63858f70e service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updated VIF entry in instance network info cache for port 725a5921-2540-4281-af5c-05d1b9124964. {{(pid=80928) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 06:24:53 user nova-compute[80928]: DEBUG nova.network.neutron [req-a61d22c0-6971-455f-a47f-ddefc30e197f req-958720ef-353a-47b4-8b0d-dcc63858f70e service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating instance_info_cache with network_info: [{"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:24:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-a61d22c0-6971-455f-a47f-ddefc30e197f req-958720ef-353a-47b4-8b0d-dcc63858f70e service nova] Releasing lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:24:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:24:53 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:24:53 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:24:53 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating instance_info_cache with network_info: [{"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:24:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:24:53 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'flavor' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:24:55 user nova-compute[80928]: INFO nova.compute.manager [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attaching volume e47321f1-7b60-43b2-b212-97d1b21bf3f0 to /dev/vdb
Nov 16 06:24:55 user nova-compute[80928]: DEBUG os_brick.utils [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28f60e3-dbd7-4829-9251-3d89ee9241a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b89b1db-2e3c-46bd-a0ce-8a701f9a47d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7da2cab-b14a-48a8-bc4c-3ee24098218a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2357eee0-1d9f-48d5-81e5-b2e7c525af86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:24:55 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9b6fd5-eb8e-458f-bcbf-b13feb55750d]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG os_brick.utils [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating existing volume attachment record: 56f549bf-a677-4bf1-9018-53b1db760f5c {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:24:55 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:24:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:24:59 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:24:59 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmVUPupM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:25:00 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:25:00 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:25:00 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6964bcee-caf8-4aaf-a068-e4329a00bb49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:25:00 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cd9f40-f043-4a7f-8085-22559e3432c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0] added
Nov 16 06:25:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[77287290-bd58-4e8d-84db-e87479482dc9]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[879f8f4c-38f9-483b-bee1-504eaaee7040]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmVUPupM {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmVUPupM" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd0d649-eba7-416f-a514-9fb28e525610]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QmVUPupM'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e06ac06-f104-4cc4-a9dc-5a5a92c2f48a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e296529-7384-4ca0-9a6d-284cd1c92602]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:25:00 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:25:00 user nova-compute[80928]:  {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:25:00 user nova-compute[80928]: WARNING os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 06:25:00 user nova-compute[80928]: 
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[76540b1e-efb1-4916-b400-5cf6343a0d1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0, portal: 172.16.0.220,3260]
Nov 16 06:25:00 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0, portal: 172.16.0.220,3260] successful.
Nov 16 06:25:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df01bea-2601-4ac7-8144-db328bee0226]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[318a9d96-5b92-4fa0-ad9d-62e23e824428]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 (non-flash)
Nov 16 06:25:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 (non-flash)
Nov 16 06:25:00 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9aa697-b424-4cb6-9c09-8cd0cf2d3fc1]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:00 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:25:01 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:25:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmVUPupM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:25:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:25:01 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26266633164353231', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:25:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266633164353231', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:25:01 user nova-compute[80928]: DEBUG nova.objects.instance [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'flavor' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:25:01 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 06:25:01 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:25:01 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:25:01 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:25:01 user nova-compute[80928]:   <serial>e47321f1-7b60-43b2-b212-97d1b21bf3f0</serial>
Nov 16 06:25:01 user nova-compute[80928]: </disk>
Nov 16 06:25:01 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 06:25:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:25:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:25:02 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No VIF found with MAC fa:16:3e:40:46:96, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:25:02 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a93c43d6-be19-4d1a-bd19-c68edf75bdad tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.717s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:25:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:25:13 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:25:13 user nova-compute[80928]: INFO nova.compute.manager [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Detaching volume e47321f1-7b60-43b2-b212-97d1b21bf3f0
Nov 16 06:25:13 user nova-compute[80928]: INFO nova.virt.block_device [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attempting to driver detach volume e47321f1-7b60-43b2-b212-97d1b21bf3f0 from mountpoint /dev/vdb
Nov 16 06:25:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Attempting to detach device vdb from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 06:25:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:25:13 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:25:13 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:25:13 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:25:13 user nova-compute[80928]:   <serial>e47321f1-7b60-43b2-b212-97d1b21bf3f0</serial>
Nov 16 06:25:13 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:25:13 user nova-compute[80928]: </disk>
Nov 16 06:25:13 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:25:13 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Successfully detached device vdb from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the persistent domain config.
Nov 16 06:25:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 06:25:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:25:13 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:25:13 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:25:13 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:25:13 user nova-compute[80928]:   <serial>e47321f1-7b60-43b2-b212-97d1b21bf3f0</serial>
Nov 16 06:25:13 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:25:13 user nova-compute[80928]: </disk>
Nov 16 06:25:13 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:25:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 06:25:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:25:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:32 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:25:33 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 is timed out.
Nov 16 06:25:33 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Successfully detached device vdb from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the live domain config.
Nov 16 06:25:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmVUPupM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:25:33 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f075ff7-cf4b-463c-a03c-127bfd086c29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:25:33 user nova-compute[80928]: No targets found.
Nov 16 06:25:33 user nova-compute[80928]: iSNS:
Nov 16 06:25:33 user nova-compute[80928]: No targets found.
Nov 16 06:25:33 user nova-compute[80928]: STATIC:
Nov 16 06:25:33 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0
Nov 16 06:25:33 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:25:33 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:25:33 user nova-compute[80928]: FIRMWARE:
Nov 16 06:25:33 user nova-compute[80928]: No targets found.
Nov 16 06:25:33 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:25:33 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:25:33 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7e6dcb-08f0-439f-b0ad-d199d3aeed58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f725943-027e-49c6-86ec-12105c68d1e1]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 (non-flash)
Nov 16 06:25:33 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 (non-flash)
Nov 16 06:25:33 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86899e8430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b61164-b34c-4de1-b4a8-1fa956e590d4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e240bd80-c99a-499a-a4ca-51ae23b38edd]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6ede1c-0996-4134-9c9c-4eb6539e1b09]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[00676a4b-6b56-4c71-8a2a-0017d25f840b]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fb4700-29cc-4d0b-ad73-d0169c54bc8a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc3e664-dcc0-4cb9-9cca-259220ffcdc8]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0, portal: 172.16.0.220,3260]
Nov 16 06:25:33 user nova-compute[80928]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0, portal: 172.16.0.220,3260] successful.
Nov 16 06:25:33 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47321f1-7b60-43b2-b212-97d1b21bf3f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a561e538-cdf8-4bed-a0de-035e5f8b5323]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] <== disconnect_volume: return (297ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:25:33 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:25:34 user nova-compute[80928]: DEBUG nova.objects.instance [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'flavor' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:25:34 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-2739aec5-fc85-4308-81a6-5bd6c8afa09f tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.625s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:25:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:25:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:25:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:25:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:25:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:25:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:25:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:25:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:25:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:25:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:40 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:25:42 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:25:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:25:48 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:25:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:25:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:25:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:25:49 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:25:49 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:25:49 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:25:50 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:25:50 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:25:50 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=25.184467315673828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing inventories for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating ProviderTree inventory for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Updating inventory in ProviderTree for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing aggregate associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, aggregates: None {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Refreshing trait associations for resource provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI {{(pid=80928) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 06:25:50 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:25:51 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:25:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:25:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:25:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:25:54 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:25:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:25:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:25:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:25:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:25:54 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:25:54 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:25:54 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating instance_info_cache with network_info: [{"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:25:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:25:54 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:25:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:25:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:25:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:25:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:25:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:25:56 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:26:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:26:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:26:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:26:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:26:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances with incomplete migration  {{(pid=80928) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 06:26:03 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:26:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:26:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:26:05 user nova-compute[80928]: DEBUG nova.objects.instance [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'flavor' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:26:05 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.204s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:26:06 user nova-compute[80928]: INFO nova.compute.manager [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attaching volume baabd740-8dd6-422c-867b-41d1e8ef8431 to /dev/vdb
Nov 16 06:26:06 user nova-compute[80928]: DEBUG os_brick.utils [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25e778b-1733-40ab-9762-e2369ee90f78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0646050a-7dd1-4b6c-8340-a2bf7e11d102]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[df842054-520a-49f5-ac12-7d51ce1322f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a3c290-e633-4899-9098-0fb9d08e4418]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:26:06 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:26:06 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fc1a5f-3849-4eb9-a88c-95319a384aa9]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG os_brick.utils [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating existing volume attachment record: fb2a39d6-7bba-4f3a-a985-b345fce30bdd {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:26:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:10 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:26:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhlkMbFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:26:10 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:26:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:26:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:26:10 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:26:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:26:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:26:10 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:26:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[866757da-6597-4322-84c1-38f801b1f64e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:26:11 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebe9ed1-726c-420b-b2c0-c6b97f97cb65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431] added
Nov 16 06:26:11 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0341fd-ebf8-4b89-853f-8692d8b3dc0d]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef90453-d2e0-4e5a-8bcd-586bba8f9333]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NhlkMbFH {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NhlkMbFH" returned: 0 in 0.022s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78819db-16eb-49aa-a2de-df4fbcb73240]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NhlkMbFH'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c928d73-2609-4472-80c6-355f78558092]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a3edce-1d2a-4da9-ab01-7179d0212c52]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:26:11 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:26:11 user nova-compute[80928]:  {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:26:11 user nova-compute[80928]: WARNING os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 06:26:11 user nova-compute[80928]: 
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[133e5fe3-337b-4cbb-be8a-9b58bb1c8029]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431, portal: 172.16.0.220,3260]
Nov 16 06:26:11 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431, portal: 172.16.0.220,3260] successful.
Nov 16 06:26:11 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[52309adf-db5f-44fa-a525-05a3de36ac6a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[80402685-e687-4ae3-8c40-ad40aa62f890]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 (non-flash)
Nov 16 06:26:11 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 (non-flash)
Nov 16 06:26:11 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8098113c-8eb0-4c37-bcf4-1f416c5e9668]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:26:11 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhlkMbFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:26:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:26:12 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23435353031643234', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:26:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435353031643234', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:26:12 user nova-compute[80928]: DEBUG nova.objects.instance [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'flavor' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:26:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 06:26:12 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:26:12 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:26:12 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:26:12 user nova-compute[80928]:   <serial>baabd740-8dd6-422c-867b-41d1e8ef8431</serial>
Nov 16 06:26:12 user nova-compute[80928]: </disk>
Nov 16 06:26:12 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 06:26:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:26:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:26:12 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No VIF found with MAC fa:16:3e:40:46:96, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:26:12 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-0c90a774-a9d7-4603-9fd8-cb9f41bc2531 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.660s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:26:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:26:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:26:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:26:15 user nova-compute[80928]: INFO nova.compute.manager [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Detaching volume baabd740-8dd6-422c-867b-41d1e8ef8431
Nov 16 06:26:15 user nova-compute[80928]: INFO nova.virt.block_device [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attempting to driver detach volume baabd740-8dd6-422c-867b-41d1e8ef8431 from mountpoint /dev/vdb
Nov 16 06:26:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Attempting to detach device vdb from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 06:26:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:26:15 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:26:15 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:26:15 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:26:15 user nova-compute[80928]:   <serial>baabd740-8dd6-422c-867b-41d1e8ef8431</serial>
Nov 16 06:26:15 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:26:15 user nova-compute[80928]: </disk>
Nov 16 06:26:15 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:26:15 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Successfully detached device vdb from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the persistent domain config.
Nov 16 06:26:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 06:26:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:26:15 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:26:15 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:26:15 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:26:15 user nova-compute[80928]:   <serial>baabd740-8dd6-422c-867b-41d1e8ef8431</serial>
Nov 16 06:26:15 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:26:15 user nova-compute[80928]: </disk>
Nov 16 06:26:15 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:26:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 06:26:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:16 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Cleaning up deleted instances {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 06:26:16 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] There are 0 instances to clean {{(pid=80928) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 06:26:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:26:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:26:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:26:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:26:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:26:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:26:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:26:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:26:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:26:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:33 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:34 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:35 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 is timed out.
Nov 16 06:26:35 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Successfully detached device vdb from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the live domain config.
Nov 16 06:26:35 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhlkMbFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:26:35 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:26:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef11d3a-36ce-4509-9cf6-b3891d70ec73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:26:35 user nova-compute[80928]: No targets found.
Nov 16 06:26:35 user nova-compute[80928]: iSNS:
Nov 16 06:26:35 user nova-compute[80928]: No targets found.
Nov 16 06:26:35 user nova-compute[80928]: STATIC:
Nov 16 06:26:35 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431
Nov 16 06:26:35 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:26:35 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:26:35 user nova-compute[80928]: FIRMWARE:
Nov 16 06:26:35 user nova-compute[80928]: No targets found.
Nov 16 06:26:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:26:35 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:26:35 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e0e2e3-ef69-4018-ac90-94b0375147e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f49790b-e91b-4eae-9d78-f0b97224612b]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 (non-flash)
Nov 16 06:26:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 (non-flash)
Nov 16 06:26:35 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86785cb2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a746608-dab3-49eb-b817-830d8c6cd6d1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24d8f43-05c2-4dfe-8942-dee209a4ef9a]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:26:35 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2564f91-4f52-40b7-865f-e9d1e63a6820]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0b3dcd-c932-4fee-a460-ec8aa8a2cc07]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4e4115-75d5-4a53-8a64-efe0faacde3a]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca374a5-0c80-4d92-95af-2db470f0e8ac]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431, portal: 172.16.0.220,3260]
Nov 16 06:26:36 user nova-compute[80928]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431, portal: 172.16.0.220,3260] successful.
Nov 16 06:26:36 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baabd740-8dd6-422c-867b-41d1e8ef8431 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f758129f-85c4-42e9-a05b-a4ba61d20775]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] <== disconnect_volume: return (262ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:26:36 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:26:37 user nova-compute[80928]: DEBUG nova.objects.instance [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'flavor' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:26:37 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-a6129a20-2e77-4c30-b870-9be361ca1dd8 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.789s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:26:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:26:42 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:42 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:26:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:26:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:26:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:26:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:26:47 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_power_states {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:47 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Triggering sync for uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 06:26:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:26:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:26:47 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:26:49 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:26:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:26:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:26:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:26:50 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:26:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:26:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:26:51 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:26:51 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:26:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=25.183528900146484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:26:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:26:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:26:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:26:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:26:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:26:51 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:26:51 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:26:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:26:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:26:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:26:55 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:26:55 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:26:55 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:26:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:26:55 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:26:55 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:26:55 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:26:56 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating instance_info_cache with network_info: [{"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:26:56 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:26:56 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:26:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:27:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:27:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:27:01 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:27:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:27:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:27:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:27:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:27:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG nova.objects.instance [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'flavor' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:27:08 user nova-compute[80928]: INFO nova.compute.manager [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attaching volume 68c8ad60-9002-4123-a92a-f31d2b619e79 to /dev/vdb
Nov 16 06:27:08 user nova-compute[80928]: DEBUG os_brick.utils [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c531bd-cd79-4888-9b63-e8e1dbe3062a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bf16b4-04a8-4d97-8cea-35c6c0a0b2c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c9a341-7649-410e-9636-17f54eabc00e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1e61f5-1f59-4de1-8db8-9a9b120bb178]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:27:08 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:27:08 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[563fcdcd-bca7-4585-8870-c28a78940cbe]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG os_brick.utils [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:27:08 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating existing volume attachment record: f585d353-9333-4531-9d16-93bfd7dfd72a {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:27:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:27:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyohEuvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:27:13 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:27:13 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:27:13 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[98778b23-4ff6-40b8-bcc0-cbbd4c7c1c8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:27:13 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[57967277-79b4-4de9-9427-c467dda1e06b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79] added
Nov 16 06:27:13 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45a56be-9150-4b54-bb57-1f78f07519dd]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cd5b2e-fd44-4d30-99a8-543a07ff8c61]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DyohEuvN {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DyohEuvN" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dcf75b-67d2-49fb-82a1-86cf67b57ed3]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DyohEuvN'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc00a3d-d6a6-4075-af14-dbf58e37a75f]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[032bf5cf-0b58-464c-8b1e-b6fdfb13c8e7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:27:13 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:27:13 user nova-compute[80928]:  {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:27:13 user nova-compute[80928]: WARNING os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 06:27:13 user nova-compute[80928]: 
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f16619-e469-4da6-b71e-70226fb247da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79, portal: 172.16.0.220,3260]
Nov 16 06:27:13 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79, portal: 172.16.0.220,3260] successful.
Nov 16 06:27:13 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e9616c-85e2-4cf7-8386-2a7e07c734b1]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5287b3-7eaf-4a4b-90b6-f2ecf7a30913]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 (non-flash)
Nov 16 06:27:13 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 (non-flash)
Nov 16 06:27:13 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8375fbac-7efa-4fdd-9845-6cbf824fccca]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:13 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:27:14 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:27:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyohEuvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:27:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:27:14 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '26130336531326164', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:27:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130336531326164', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:27:14 user nova-compute[80928]: DEBUG nova.objects.instance [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'flavor' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:27:14 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 06:27:14 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:27:14 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:27:14 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:27:14 user nova-compute[80928]:   <serial>68c8ad60-9002-4123-a92a-f31d2b619e79</serial>
Nov 16 06:27:14 user nova-compute[80928]: </disk>
Nov 16 06:27:14 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 06:27:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:27:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:27:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No VIF found with MAC fa:16:3e:40:46:96, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:27:15 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-14e8fd81-aa60-4d97-ab48-10f2ee6ce17e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.632s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:27:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:27:18 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:27:18 user nova-compute[80928]: INFO nova.compute.manager [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Detaching volume 68c8ad60-9002-4123-a92a-f31d2b619e79
Nov 16 06:27:18 user nova-compute[80928]: INFO nova.virt.block_device [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attempting to driver detach volume 68c8ad60-9002-4123-a92a-f31d2b619e79 from mountpoint /dev/vdb
Nov 16 06:27:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Attempting to detach device vdb from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 06:27:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:27:18 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:27:18 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:27:18 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:27:18 user nova-compute[80928]:   <serial>68c8ad60-9002-4123-a92a-f31d2b619e79</serial>
Nov 16 06:27:18 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:27:18 user nova-compute[80928]: </disk>
Nov 16 06:27:18 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:27:18 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Successfully detached device vdb from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the persistent domain config.
Nov 16 06:27:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 06:27:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:27:18 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:27:18 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:27:18 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:27:18 user nova-compute[80928]:   <serial>68c8ad60-9002-4123-a92a-f31d2b619e79</serial>
Nov 16 06:27:18 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:27:18 user nova-compute[80928]: </disk>
Nov 16 06:27:18 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:27:18 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 06:27:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:27:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:27:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:27:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:27:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:34 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:27:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:27:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:27:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:27:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:27:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:35 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:27:38 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 is timed out.
Nov 16 06:27:38 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Successfully detached device vdb from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the live domain config.
Nov 16 06:27:38 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyohEuvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:27:38 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2481d86-8ed5-4b54-99e7-625e2f6f5556]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:27:38 user nova-compute[80928]: No targets found.
Nov 16 06:27:38 user nova-compute[80928]: iSNS:
Nov 16 06:27:38 user nova-compute[80928]: No targets found.
Nov 16 06:27:38 user nova-compute[80928]: STATIC:
Nov 16 06:27:38 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79
Nov 16 06:27:38 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:27:38 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:27:38 user nova-compute[80928]: FIRMWARE:
Nov 16 06:27:38 user nova-compute[80928]: No targets found.
Nov 16 06:27:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:27:38 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:27:38 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[260ccecb-b0cf-407e-97bf-33f9a8c71de4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeda449-a7ca-4405-a71f-91adcf398101]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 (non-flash)
Nov 16 06:27:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 (non-flash)
Nov 16 06:27:38 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8678127760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[195bff5b-058b-4550-975a-6700f1bac7bf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[284db358-458f-429d-b5ab-87cfa203d707]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c27c7d-f83a-4731-afdd-3d13d0754c97]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d27c8ae-f59c-4b16-8259-8ecb5e4f4790]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad9f278-c923-4568-9734-582681d2f2c7]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:27:38 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[89efed01-ffa3-436d-a54c-f647e0792f54]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79, portal: 172.16.0.220,3260]
Nov 16 06:27:39 user nova-compute[80928]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79, portal: 172.16.0.220,3260] successful.
Nov 16 06:27:39 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:27:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:39 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c8ad60-9002-4123-a92a-f31d2b619e79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:39 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5c590d-c53c-445e-9684-73b64e5acf78]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:27:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:27:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:27:39 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] <== disconnect_volume: return (278ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:27:39 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:27:39 user nova-compute[80928]: DEBUG nova.objects.instance [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'flavor' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:27:40 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-53bd5d31-2f4a-4e13-bff4-16371bb738fe tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.827s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:27:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:42 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:27:44 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:27:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:27:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:27:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:27:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:27:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:27:50 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:27:50 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:27:50 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:27:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:27:51 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:27:51 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:27:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.182514190673828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:27:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:27:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:27:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:27:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:27:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:27:51 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:27:51 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:27:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:27:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:27:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:27:57 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:27:57 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:27:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:27:57 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:27:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:27:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:27:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:27:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:27:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating instance_info_cache with network_info: [{"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:27:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:27:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:28:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:28:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:28:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:28:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:28:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:00 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:28:03 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:28:03 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:28:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:28:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:28:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:28:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:28:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG nova.objects.instance [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'flavor' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:28:10 user nova-compute[80928]: INFO nova.compute.manager [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attaching volume c3815a5b-5ce5-4204-b3d0-e5eabae1300d to /dev/vdb
Nov 16 06:28:10 user nova-compute[80928]: DEBUG os_brick.utils [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db92ba-c971-4e7f-800a-c77dbeb73a84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:88ff620b248\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[af180b7e-fd24-4d34-bab1-4ab598fbf1dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9103b382-45c7-42c4-a110-1dca462cf367]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df13519-c397-4733-81fe-895918ec6542]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Running cmd (subprocess): nvme version {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] 'nvme version' failed. Not Retrying. {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] nvme not present on system {{(pid=80928) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 06:28:10 user nova-compute[80928]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 06:28:10 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a367feb-7d4a-4534-aeb3-ebb55b8d3d7d]: (4, '') {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=80928) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.lightos [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] LIGHTOS: no hostnqn found. {{(pid=80928) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG os_brick.utils [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:88ff620b248', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:28:10 user nova-compute[80928]: DEBUG nova.virt.block_device [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating existing volume attachment record: 5b90db59-8ea5-40fb-9336-f62521aa904d {{(pid=80928) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 06:28:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Calling os-brick to attach iSCSI Volume {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XPrmkfRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:28:15 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:28:15 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:28:15 user nova-compute[80928]: INFO os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13b05fa-8ad8-4309-9707-3b6d2041a0fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 06:28:15 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --interface default --op new {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[23575846-d454-4c3c-889a-757ecd59b607]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d] added\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d] added
Nov 16 06:28:15 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4ae863-17c1-4019-9dee-769557d8a54e]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ce53b9-7b5d-427d-a516-5f266faa9875]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XPrmkfRU {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XPrmkfRU" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[49597929-9754-4225-8e63-0373fe0da671]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XPrmkfRU'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab1bd80-abb5-4bec-b9b5-c91b84ae62f9]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[32de8e1c-8262-4603-945a-b5c494ca7d2f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:28:15 user nova-compute[80928]:  {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 06:28:15 user nova-compute[80928]:  {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:28:15 user nova-compute[80928]: WARNING os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 06:28:15 user nova-compute[80928]: 
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --login {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[af543940-0694-4532-8c90-674536ab1f4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d, portal: 172.16.0.220,3260]
Nov 16 06:28:15 user nova-compute[80928]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d, portal: 172.16.0.220,3260] successful.
Nov 16 06:28:15 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[166475a9-a168-4a36-95c3-48b74e89f840]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dc9b50-1bbb-4bf3-88b2-d33800cc09ba]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d (non-flash)
Nov 16 06:28:15 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d (non-flash)
Nov 16 06:28:15 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Connected to 172.16.0.220:3260 {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=80928) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=80928) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ba32da-f13c-40df-a067-5725a5ca700a]: (4, ('- - 0', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=80928) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 06:28:15 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XPrmkfRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=80928) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 06:28:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:28:16 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23730373164326163', 'path': '/dev/sdb'} {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:28:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730373164326163', 'path': '/dev/sdb'} {{(pid=80928) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 06:28:16 user nova-compute[80928]: DEBUG nova.objects.instance [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'flavor' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:28:16 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 06:28:16 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:28:16 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:28:16 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:28:16 user nova-compute[80928]:   <serial>c3815a5b-5ce5-4204-b3d0-e5eabae1300d</serial>
Nov 16 06:28:16 user nova-compute[80928]: </disk>
Nov 16 06:28:16 user nova-compute[80928]:  {{(pid=80928) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 06:28:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No BDM found with device name vda, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:28:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=80928) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 06:28:17 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] No VIF found with MAC fa:16:3e:40:46:96, not building metadata {{(pid=80928) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 06:28:17 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-24e70cd4-89ed-49cf-91ba-387c2720af53 tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.756s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:28:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:28:19 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:28:19 user nova-compute[80928]: INFO nova.compute.manager [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Detaching volume c3815a5b-5ce5-4204-b3d0-e5eabae1300d
Nov 16 06:28:19 user nova-compute[80928]: INFO nova.virt.block_device [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Attempting to driver detach volume c3815a5b-5ce5-4204-b3d0-e5eabae1300d from mountpoint /dev/vdb
Nov 16 06:28:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Attempting to detach device vdb from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the persistent domain config. {{(pid=80928) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 06:28:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:28:19 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:28:19 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:28:19 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:28:19 user nova-compute[80928]:   <serial>c3815a5b-5ce5-4204-b3d0-e5eabae1300d</serial>
Nov 16 06:28:19 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:28:19 user nova-compute[80928]: </disk>
Nov 16 06:28:19 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:28:19 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Successfully detached device vdb from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the persistent domain config.
Nov 16 06:28:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the live domain config. {{(pid=80928) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 06:28:19 user nova-compute[80928]: DEBUG nova.virt.libvirt.guest [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 06:28:19 user nova-compute[80928]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 06:28:19 user nova-compute[80928]:   <source dev="/dev/sdb"/>
Nov 16 06:28:19 user nova-compute[80928]:   <target dev="vdb" bus="virtio"/>
Nov 16 06:28:19 user nova-compute[80928]:   <serial>c3815a5b-5ce5-4204-b3d0-e5eabae1300d</serial>
Nov 16 06:28:19 user nova-compute[80928]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 06:28:19 user nova-compute[80928]: </disk>
Nov 16 06:28:19 user nova-compute[80928]:  {{(pid=80928) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 06:28:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:28:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:28:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:28:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:28:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:20 user nova-compute[80928]: DEBUG nova.virt.libvirt.driver [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 06:28:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:30 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:35 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:36 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:28:37 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:40 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 is timed out.
Nov 16 06:28:40 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Successfully detached device vdb from instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 from the live domain config.
Nov 16 06:28:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] calling os-brick to detach iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86782224d0>, {'target_iqn': 'iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XPrmkfRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 06:28:40 user nova-compute[80928]: WARNING os_brick.initiator.connectors.base [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[90afe5bc-cbd9-42f8-8604-5df9507a255b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 06:28:40 user nova-compute[80928]: No targets found.
Nov 16 06:28:40 user nova-compute[80928]: iSNS:
Nov 16 06:28:40 user nova-compute[80928]: No targets found.
Nov 16 06:28:40 user nova-compute[80928]: STATIC:
Nov 16 06:28:40 user nova-compute[80928]: Target: iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d
Nov 16 06:28:40 user nova-compute[80928]:         Portal: 172.16.0.220:3260,-1
Nov 16 06:28:40 user nova-compute[80928]:                 Iface Name: default
Nov 16 06:28:40 user nova-compute[80928]: FIRMWARE:
Nov 16 06:28:40 user nova-compute[80928]: No targets found.
Nov 16 06:28:40 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 06:28:40 user nova-compute[80928]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 06:28:40 user nova-compute[80928]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=80928) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d', 0)] {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58c430f-42df-46dc-9f32-99017ebc6925]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f545bbb0-7d1a-4dba-ae91-c8f3aa735a16]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d (non-flash)\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d (non-flash)
Nov 16 06:28:40 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d (non-flash)
Nov 16 06:28:40 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86585cfb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d'): ({'sdb'}, set())}) {{(pid=80928) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Removing single pathed devices sdb {{(pid=80928) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc960466-da41-48c5-a53a-fe436fad4f25]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f323eb75-fa68-4947-b0be-0545616e3a7d]: (4, ('ok\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Flushing IO for device /dev/sdb {{(pid=80928) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef865c4-f382-433b-8702-6338e1b29944]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=80928) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[088b5b0a-6011-4173-996c-d4b5404fecd7]: (4, ('1', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.linuxscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] SCSI volumes sdb have been removed. {{(pid=80928) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d')] {{(pid=80928) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f5c65e-4c8d-4317-a6c6-c05a4b7755ff]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --logout {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --logout" returned: 0 in 0.039s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[529e6700-d794-4890-acda-40ee5c933258]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d, portal: 172.16.0.220,3260]
Nov 16 06:28:40 user nova-compute[80928]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d, portal: 172.16.0.220,3260] successful.
Nov 16 06:28:40 user nova-compute[80928]:  stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op delete {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3815a5b-5ce5-4204-b3d0-e5eabae1300d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=92262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7128289d-8a62-40b2-a708-5e7ab4c1f089]: (4, ('', '')) {{(pid=92262) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=80928) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.base [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.249s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] <== disconnect_volume: return (250ms) None {{(pid=80928) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 06:28:40 user nova-compute[80928]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Disconnected iSCSI Volume {{(pid=80928) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 06:28:41 user nova-compute[80928]: DEBUG nova.objects.instance [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'flavor' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:28:41 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-f44ef785-0707-4ad9-8567-9e1845706d8e tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.530s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:28:44 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:28:45 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:28:45 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:28:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:28:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:28:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:28:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:28:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:28:50 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:28:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:28:51 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:28:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:28:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:28:51 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:28:51 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:28:51 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 06:28:52 user nova-compute[80928]: DEBUG oslo_concurrency.processutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=80928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 06:28:52 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:28:52 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:28:52 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=25.181549072265625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:28:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:28:52 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:28:52 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Instance cd9be15f-178f-4cec-a49d-ae9bf5c38780 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=80928) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 06:28:52 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:28:52 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:28:52 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:28:53 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:28:53 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:28:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:28:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:28:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:28:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:28:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:28:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:28:55 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:28:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:28:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:28:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:28:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 06:28:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquired lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 06:28:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Forcefully refreshing network info cache for instance {{(pid=80928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 06:28:58 user nova-compute[80928]: DEBUG nova.objects.instance [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lazy-loading 'info_cache' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:28:58 user nova-compute[80928]: DEBUG nova.network.neutron [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating instance_info_cache with network_info: [{"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:28:58 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Releasing lock "refresh_cache-cd9be15f-178f-4cec-a49d-ae9bf5c38780" {{(pid=80928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 06:28:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updated the network info_cache for instance {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 06:29:00 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:01 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:29:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:29:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:29:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:29:05 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:05 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:29:05 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:29:10 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:29:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:29:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:29:15 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:20 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:29:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:29:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:29:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:29:25 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:29:25 user nova-compute[80928]: INFO nova.compute.manager [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Terminating instance
Nov 16 06:29:25 user nova-compute[80928]: DEBUG nova.compute.manager [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Start destroying the instance on the hypervisor. {{(pid=80928) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 06:29:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:25 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-bf33bc46-cfdd-4f9b-bfcd-6a415c1b1425 req-18e14107-a63e-47c7-88eb-e34c27229571 service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Received event network-vif-unplugged-725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bf33bc46-cfdd-4f9b-bfcd-6a415c1b1425 req-18e14107-a63e-47c7-88eb-e34c27229571 service nova] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bf33bc46-cfdd-4f9b-bfcd-6a415c1b1425 req-18e14107-a63e-47c7-88eb-e34c27229571 service nova] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-bf33bc46-cfdd-4f9b-bfcd-6a415c1b1425 req-18e14107-a63e-47c7-88eb-e34c27229571 service nova] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-bf33bc46-cfdd-4f9b-bfcd-6a415c1b1425 req-18e14107-a63e-47c7-88eb-e34c27229571 service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] No waiting events found dispatching network-vif-unplugged-725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG nova.compute.manager [req-bf33bc46-cfdd-4f9b-bfcd-6a415c1b1425 req-18e14107-a63e-47c7-88eb-e34c27229571 service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Received event network-vif-unplugged-725a5921-2540-4281-af5c-05d1b9124964 for instance with task_state deleting. {{(pid=80928) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [-] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Instance destroyed successfully.
Nov 16 06:29:26 user nova-compute[80928]: DEBUG nova.objects.instance [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lazy-loading 'resources' on Instance uuid cd9be15f-178f-4cec-a49d-ae9bf5c38780 {{(pid=80928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG nova.virt.libvirt.vif [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T06:23:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1356063432',display_name='tempest-SnapshotDataIntegrityTests-server-1356063432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1356063432',id=53,image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr0Iz0f0IYXeNPFuV0JDKd+4cNS1kCubJtlwPB0L9Wxe7+OlolsnvLC07NwV8tRJfBReK0uVUnMN9V/WOy9Avv8DIpbWgfM20czReidGjhWYIZoduj9Zdb4B1shBtSAjg==',key_name='tempest-keypair-736099567',keypairs=<?>,launch_index=0,launched_at=2023-11-16T06:23:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95a03daf1cbb48a3bd8abc10d1c22443',ramdisk_id='',reservation_id='r-1ag3u252',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c747fce3-6158-4d78-9cb4-34afacae8f7a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1419883759',owner_user_name='tempest-SnapshotDataIntegrityTests-1419883759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T06:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='971ec18e5f0447d3933d3bed657cf72c',uuid=cd9be15f-178f-4cec-a49d-ae9bf5c38780,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Converting VIF {"id": "725a5921-2540-4281-af5c-05d1b9124964", "address": "fa:16:3e:40:46:96", "network": {"id": "941378c4-8aef-4417-9aff-3d37cc95e095", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1443344616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95a03daf1cbb48a3bd8abc10d1c22443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725a5921-25", "ovs_interfaceid": "725a5921-2540-4281-af5c-05d1b9124964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG nova.network.os_vif_util [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:46:96,bridge_name='br-int',has_traffic_filtering=True,id=725a5921-2540-4281-af5c-05d1b9124964,network=Network(941378c4-8aef-4417-9aff-3d37cc95e095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725a5921-25') {{(pid=80928) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG os_vif [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:46:96,bridge_name='br-int',has_traffic_filtering=True,id=725a5921-2540-4281-af5c-05d1b9124964,network=Network(941378c4-8aef-4417-9aff-3d37cc95e095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725a5921-25') {{(pid=80928) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap725a5921-25, bridge=br-int, if_exists=True) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3355439b-026c-4b9d-9504-b15727337de1) {{(pid=80928) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:26 user nova-compute[80928]: INFO os_vif [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:46:96,bridge_name='br-int',has_traffic_filtering=True,id=725a5921-2540-4281-af5c-05d1b9124964,network=Network(941378c4-8aef-4417-9aff-3d37cc95e095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725a5921-25')
Nov 16 06:29:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Deleting instance files /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780_del
Nov 16 06:29:26 user nova-compute[80928]: INFO nova.virt.libvirt.driver [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Deletion of /opt/stack/data/nova/instances/cd9be15f-178f-4cec-a49d-ae9bf5c38780_del complete
Nov 16 06:29:26 user nova-compute[80928]: INFO nova.compute.manager [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 06:29:26 user nova-compute[80928]: DEBUG oslo.service.loopingcall [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=80928) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG nova.compute.manager [-] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Deallocating network for instance {{(pid=80928) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 06:29:26 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] deallocate_for_instance() {{(pid=80928) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 06:29:27 user nova-compute[80928]: DEBUG nova.network.neutron [-] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Updating instance_info_cache with network_info: [] {{(pid=80928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 06:29:27 user nova-compute[80928]: INFO nova.compute.manager [-] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Took 0.74 seconds to deallocate network for instance.
Nov 16 06:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:29:27 user nova-compute[80928]: DEBUG nova.compute.manager [req-d6dabc77-e594-4add-ae0c-ae6b7a1996b1 req-686461c9-7a68-4d00-b415-0e47a2279bd9 service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Received event network-vif-deleted-725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:29:27 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:29:27 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:29:27 user nova-compute[80928]: INFO nova.scheduler.client.report [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Deleted allocations for instance cd9be15f-178f-4cec-a49d-ae9bf5c38780
Nov 16 06:29:27 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-94d74474-5a0e-441b-97c9-019c4869239c tempest-SnapshotDataIntegrityTests-1419883759 tempest-SnapshotDataIntegrityTests-1419883759-project-member] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:29:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-6cfd287e-bee2-45db-a0fa-8e5ed7229882 req-5c296fe8-2ca0-4aa5-85b4-7117e7008870 service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Received event network-vif-plugged-725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 06:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6cfd287e-bee2-45db-a0fa-8e5ed7229882 req-5c296fe8-2ca0-4aa5-85b4-7117e7008870 service nova] Acquiring lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6cfd287e-bee2-45db-a0fa-8e5ed7229882 req-5c296fe8-2ca0-4aa5-85b4-7117e7008870 service nova] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:29:28 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [req-6cfd287e-bee2-45db-a0fa-8e5ed7229882 req-5c296fe8-2ca0-4aa5-85b4-7117e7008870 service nova] Lock "cd9be15f-178f-4cec-a49d-ae9bf5c38780-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:29:28 user nova-compute[80928]: DEBUG nova.compute.manager [req-6cfd287e-bee2-45db-a0fa-8e5ed7229882 req-5c296fe8-2ca0-4aa5-85b4-7117e7008870 service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] No waiting events found dispatching network-vif-plugged-725a5921-2540-4281-af5c-05d1b9124964 {{(pid=80928) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 06:29:28 user nova-compute[80928]: WARNING nova.compute.manager [req-6cfd287e-bee2-45db-a0fa-8e5ed7229882 req-5c296fe8-2ca0-4aa5-85b4-7117e7008870 service nova] [instance: cd9be15f-178f-4cec-a49d-ae9bf5c38780] Received unexpected event network-vif-plugged-725a5921-2540-4281-af5c-05d1b9124964 for instance with vm_state deleted and task_state None.
Nov 16 06:29:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:38 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:29:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:29:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:29:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:29:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:29:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:45 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:29:45 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:29:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:29:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:29:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:29:46 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:50 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:29:51 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:53 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager.update_available_resource {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:29:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:29:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:29:53 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:29:53 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Auditing locally available compute resources for user (node: user) {{(pid=80928) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 06:29:54 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:29:54 user nova-compute[80928]: WARNING nova.virt.libvirt.driver [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 06:29:54 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Hypervisor/Node resource view: name=user free_ram=9144MB free_disk=25.208602905273438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=80928) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 06:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 06:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 06:29:54 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 06:29:54 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=80928) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 06:29:54 user nova-compute[80928]: DEBUG nova.compute.provider_tree [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed in ProviderTree for provider: 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e {{(pid=80928) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 06:29:54 user nova-compute[80928]: DEBUG nova.scheduler.client.report [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Inventory has not changed for provider 7c2bca45-4d73-4fca-baf6-06c1e78dcd4e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=80928) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 06:29:54 user nova-compute[80928]: DEBUG nova.compute.resource_tracker [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Compute_service record updated for user:user {{(pid=80928) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 06:29:54 user nova-compute[80928]: DEBUG oslo_concurrency.lockutils [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=80928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 06:29:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:29:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:29:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:29:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:29:56 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:29:58 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:29:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Starting heal instance info cache {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 06:29:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Rebuilding the list of instances to heal {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 06:29:58 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Didn't find any instances for network info cache update. {{(pid=80928) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 06:30:00 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:30:01 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:30:02 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:30:06 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:30:07 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:30:07 user nova-compute[80928]: DEBUG nova.compute.manager [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=80928) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 06:30:11 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:30:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:30:16 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:30:19 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:30:21 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:30:22 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:30:26 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:30:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:30:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:30:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:30:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:30:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:30:31 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:30:36 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:30:39 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:30:40 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:30:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 06:30:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:30:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=80928) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 06:30:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:30:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=80928) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 06:30:41 user nova-compute[80928]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=80928) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 06:30:45 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 06:30:45 user nova-compute[80928]: DEBUG oslo_service.periodic_task [None req-77ebf61d-3ea6-4a7e-9072-4a3f10a37369 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=80928) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}